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Description 
Technical Field 

5 A portion ot the disclosure of this patent document contains niaterial which is subject to copyright protection. The 

copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclo- 
sure, as It appears in the Patent and Tradennark Office patent file or records, but otherwise reserves all copyright rights 
whatsoever. 

The present invention relates to a computerized information system for dynamically organizing infomriation in order 
10 to present to a user previously unrecognized relationships among portions of the information and for presenting tech- 
niques for navigation through the information. 

Background Art 

IS In nrK)st fields of endeavor today, people require access to large kxxJies of infomnatbn. Frequently the Infomoatlon 

Is textual, but it might also include pictures, graphical Images or auditory signals. For example, medical records nrtay 
include x-rays, ekgs. patient descriptions and CT scans. Whether the area is medicine, art history, car mechanics, or 
home shopping, there is a need to organize information for presentation to a user and to make that organization flexible 
and dynamic. An Important feature of the present Intelligent Optical Navigator (ION) system Is its dynamic nature. That 

20 is, as the user browses through Information available in the system, bo\h the structure of the Information and the nrianner 
of presenting it is changed in response to the user's input, and this is accomplished without the need for re-programming, 
which typically would require the skills and expertise of a system devek>per. This dynamic re-structuring allows a user 
to organize and view information according to the user's needs and preferences. As Is described below, toda/s tech- 
nology does not provide the dynamb. flexible re-organization and presentation of information which is present in the 

25 ION system. 

In today's technology, databases are often used to organize and present information (for further infornnation on 
typical database technology, see Date, C, An introduction to Database Svstenrts. Reading: Addison-Weslev . 1-80, 
1982). Most databases Include only text, but more recent advances allow access to visual databases as well (see, for 
example, Roussopoulos, N., Fatoutsos, F. and Sellis. T, An efficient pictorial database system for PSQL. IEEE Trans- 

30 actions on Software Engineering, vol. 1 4, 639-650. 1 988). 

A limitation of traditional database technotogy is that it does not allow a user to organize information dynamically 
to fit the user's Individual needs. Once an initial stmcture is built into the database, access to information is limited to 
the pre-buitt structure, typically a fixed set of queries. Through a series of nrtanlpulatlons, a system developer can add 
new queries using special query languages, but a system user Is restricted to the types of queries which have been 

35 built in by the system developer. In that sense, the systems are not dynamic. In addition, Items of informatk>n must be 
accessed sequentially. If, for example, a user asks for records of patients who visited a clinic on July 3rd and who had 
a diagnosis of heart disease, the system would pull up perhaps 30 patient records which then would be viewed se- 
quentially. There is no possibility of viewing the data using an organization specified by the user as the user views the 
data unless that organizatbn has been pre-built into the system by a system developer. In traditional systems, it also 

40 is Impossible for a user to add into the system new information about artDitrary relationships between items of data. 
Suppose, for example, that a user wanted to Indicate that patient A is related to patient B. Unless a 'related" concept 
already existed in the system, the informatk)n could not be added. 

The advent of hypertext systems has alleviated some, but not all, of these concerns (typical hypertext systems 
are described in Conklin, J.. Hypertext: An Introduction and sun^ey, IEEE Computer, 17-41. September, 1987). In a 

4S typical hypertext system, a user may place arbitrary links between Items of information and use these links to browse 
through information. However, in hypertext systems, the structure is limited to simple links between two items, and 
views Into the data cannot be changed dynamically. A user cannot dynamically devise a new structure with which to 
view the data without asking a system developer to write new code. The ability to devise new structures is often im- 
portant because it is the structure which helps give users an understanding of where they are currently located and 

so where they can move within a space of data. 

Accordingly, a problem with today's technology for infomnation organizatk)n and presentatk)n Is that it lacks the 
flexibility to provide the capability for a user to dynamically re-arrange the presentatton based upon the user's needs. 
For example, suppose that a user wishes to view travel tnfomiatbn about different cities. With a typical database 
system, the user could specify certain characteristics about a city such as size and weather, and retrieve Infonnation 

ss about cities which meet those characteristics. In a typical hypertext system, the user could point to a map to Indicate 
a geographical area, retrieve infomnatkvi about a city in that region, browse sequentially through information on its 
hotels, weather, and entertainment, and then jump to infornr^tlon whk:h supplements the entertainment information 
currently on the screen. It would be difficult, however, to view simultaneously three or four cities whk:h are organized 
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on the user's monitor according to a structure defined by the user, for example, to create a definition of city-similarlty 
and use the newly-created definition to find cities similar to the one on view. These functions require the ability of a 
system to dynamically re-organize based on user needs. 

The present system circumvents these difficulties by providing a flexible structure for storing mufti-media informa- 

5 tton and a series of presentation nruxies. each of which provides a different view of the Information and an organization 
which can be altered dynamically by the user. The preferred system also provides user modeling (for example, it can 
monitor user activity to determine preferences and incorporate these preferences into future interactbn with the user) 
and easy movement between related information in the multiple presentation modes (for example, a user may easily 
view the same infonrnation from the perspectives of two or three different presentation modes). The present system 

10 can be integrated with database or hypertext systems to serve as an intelligent front end to these systents and to 
provide the structure and dynamic reorganization capabilities desired while providing access to previously stored 
information. In addition to its use as an intelligent front end to a database, it can be integrated into many other types 
of systems such as tutorial, training, or simulation systems. 

There are six presentation modes available in the current system. These are referred to in the present application 

IS as the Space Explorer, Nearest Neighbor, Focus, Dynamic Image Scanner, Living Equations, and SNETS systems. 
Each presentation mode will be described briefly below and compared with prior art which relates most closely to the 
mode. 

The present Space Explorer system provides a method for organizing information into an n-dimensional space 
where the dimensions and methods of navigation through the space are selected by a user and may be changed 

20 dynamically. For example, suppose that a user wished to browse through information on art history. With the Space 
Explorer system, the user could decide to view only information on 20th century artists from the United States and then 
could ask the system to structure the information according to artist, medium and art-style. The Space Explorer system 
then would present a "three dimensional space' where the dimensions are artist, medium and art-style. A center work 
of art would be surrounded by three satellites, each differing from the center on one of the selected dimensions. The 

25 user then could navigate through the space by changing values on any of the dimensions displayed, thus causing the 
entire space to be re-organized dynamk^aily. For example, if the user changed artist to 'Chagall', all presented works 
of art would for that moment become 'Chagall' pieces of art. with the other dimensbn values remaining intact. Navi- 
gation could also be accomplished by altering the dimensions, selecting new dimensbns or adding dimensk>ns to the 
current stnjcture. 

30 The ability to provide a structure based on an n-dimensional space and to dynamically alter the structure are unique 
characteristk^s of the Space Explorer system. Sustik and Brooks (Sustik. J., Brooks. T, Retreiving lnformatk>n with 
Interactive Videodiscs. Journal of the Amertean Society for Information Science. 34, 424-432, 1983) describe an idea 
in which a user can browse through information by gradually changing a value along a continuum such as color How- 
ever, only one dimension can be selected at a time, and the klea was not devebped into a system. Educomp has 

^ released a 'Macintosh' computer demo under the trademark "Mac a Mug" in which a graphic representation of a face 
is presented, and a user can browse through possible faces by altering characteristbs such as hair style (MacGuide, 
Vol 1. page 179A, 1988). In the "Mac a Mug" system, the potential characteristbs are pre-defined and may not be 
changed. None of these systems allows for dynamic re-organ izafion of an n-dimensbnal space. 

The preferred Nearest Neighbor system allows a user to create and use definitions of similarity in order to organize 

^ a plurality of concepts dynamically according to their similarity. For example, a user might select a concept "car" and 
a definition of similarity which Indicates that another car is similar to the first if It Is made by the same manufacturer, 
has roughly the same price and roughly the same engine size. The user might also indicate that seating capacity shouU 
be considered but shouM be a k>wer prbrity in a similarity definitkxi. Using these criteria, the Nearest Neighbor system 
can retrieve information on several cars which are most similar to the initially selected car An Important component of 

4S the system is the ability of a user to create similarity definitions and to use a plurality of definitions in a single retrieval 
session. Thus, the system is dynamic and can be tailored to an Individual's needs. 

The Nearest Neighbor system differs from databases and hypertext systems by providing dynamically changing 
definitions of similarity and using them to structure the data. In database systems, queries must be pre-defined by a 
system devetoper and cannot be changed by a system user, and there is no concept of a "similarity" query. In hypertext 

so systems a user may follow links but may not make similarity queries. Another example of prior art Is pattern recognitksn 
systems whbh help to categorize objects by their attributes but do not allow a user to specify arbitrary similarity d^- 
nitbns or to use newly created definitions to access related data (see for example. Duda. R.. and Hart, R. Pattern 
Classification and Scene Analysis . 1 - 9, New York. Wiley & Sons, 1973). They typically are quite slow, require complex 
mathematba! analysis, and are used most often to perform image analysis. Thus, the Nearest Neighbor system pio- 

ss vides a new way of thinking about and organizing informatbn which can be very useful because it Is flexible andean 
be mokied to a user's needs. 

The preferred Focus system allows a user to view a real worteJ object from a number of different perspectives. For 
example, a user might want to view a car from a number of different positbns and distances; the Focus system makes 
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it easy for a user to select and change the position and distance. An important part of the Focus system is the flexibility 
provided in selection of real world object characteristics and values which are of interest tn a particular situation and 
which provide access to a set of perspectives. A typical prior art system might provkle access to multiple views of an 
object, but the views are pre-built and cannot -be changed dynamically. 

5 For example, a training system identified by the trademark "Electric Cadaver" (Byte, p. 14, August. 1 988) provides 

a medical student with the ability to view anatomy by zooming tn on a body part, rotating the part and viewing it via x- 
ray or graphics, it supports only limited editing of text and animatbn sequences. The Cardiac Imaging Project devebped 
by Lynch (MACUSER, p. 261. May, 1988) provides animation sequences of anatomy and physblogy of the heart, but 
these may only be viewed sequentially. A system identified by the name "HeartLab* system (see Bergeron, B. . Greenes. 

10 R., HeartLab and EkgLab: Skill-Building Simulations in Cardiology, Demonstrations Digest, 11th Annual Symposium 
on Computer Applk:atk>ns in Medbal Care. 29-30. 1 987) provides graphic views of the heart for use in training in heart 
disease. When an area of the heart is selected, corresponding heart sounds may be heard. Unlike the Focus system, 
these systems are all domain dependent. The Search/Retrieval System described in U.S. patent 4,736,308 entitled 
"Search/Retrieval System* provides multiple pieces of infomrtatlon simultaneously. However, information may only be 
textual, and there is not an intelligent aid provided to help select the information for display. 

Other examples of prior art may be found in computer-aided design (CAD) and computer-aided engineering (CAE) 
systems used to develop and manipulate representations of physical objects (see for example, My klebust, A. , Mechan- 
ical computer-aided engineering, IEEE Computer Graphics and Applications, 24-25, March, 1988. and Gossard, D.. 
Zuffante. R., and Sakurai, H., Representing Dimensions, Tolerances, and Features in MCAE Systems, IEEE Computer 

20 Graphbs and Applications, 51 -59, March, 1 988). The representations used in these systems are limited to line drawings 
or solid renderings based on computer graphics. The preferred Focus system is not limited in this regard, but can 
present to a user any video image or sequence. It also allows a user to specify dynamically a desired representation, 
context and level of detail. 

In all of these prbr art systems, the views available are built in by a system devebper and generally may not be 

2S changed by a user. In contrast, the present Focus system provides the user with dynamic control over organization of 
presentatbn and method of navigating through the information. -For example, the user may decide at one moment to 
view an object according to an organization based on distance from the object and position of the object, and in the 
next moment to view the object according to an organization based on functbnai use of the object. The user may 
dynamically navigate through the information by changing an object attribute in the existing organization or by changing 

30 the entire organlzatbn. The advantage of this system Is that the user selects the structure most helpful for the user's 
current situation, and the new structure is Implemented immediately 

The present Dynamic Image Scanner system allows a user to navigate through a plurality of concepts by manip- 
ulating graphical representations of concepts. For example, a user who is interested in 'chairs' might be presented 
with a graphical representation of a 'standard chair.' The user might manipulate the image graphically to indicate a 

35 chair of a greater width. The system can interpret the manipulation and use it to access information about a chair which 
matches the new graphical representatbn; perhaps the new chair might be a bve seat The Dynamic image Scanner 
system is particularty useful in browsing through informatbn in situatbns in which it is difficult to describe verbally the 
modifications one has in mind. It might be hard to describe a chair which has a particular form but easy to draw the 
form. The system is dynamic and flexible because the user has the ability not only to make graphical manipulations 

40 but also to select the relationship desired between graphical interpretation and concepts selected. That is, in one case, 
the user might askfor a chair whbh is cbsest In form to the one drawn. In another case, the user might ask for informatbn 
about the process of bulbing such a chair. 

There are many systems available which allow a user to make graphb manipulatbns on a screen. For example, 
graphics packages allow a user to draw complex objects, and CAD/CAM systems allow a user to manipulate 2-d and 

4S 3-d images. However, these packages have no method of interpreting manipulations and using interpretations to access 
related informatbn. The 'Electric Cadaver* system mentioned above allows a user to manipulate a nen/e on a graphb 
representation of the body and access informatbn on related disorders. However, there is only one type of manipulation 
available, and only one type of relationship available. In additbn, it ts tied to a specific medical applicatbn. Hypertecl 
and database systems do not incorporate graphic manipulation into their querying techniques. 

so The preferred Living Equatbns system allows a user to examine both numerical and graphical representations ol 

an equation, to manipulate the equation by altering the form of the equatbn. the values, or the units, and to examme 
relationships between ternns of the equatbn and between concepts whbh are available in other systems such as Ihe 
SNETS system described below. There are systems available whbh provide much more complex analyses of malhe- 
matical relationships but which are not as flexible. For example, they may be tied to a particular domain. A case b 

ss point is a system bentified by the name 'STEAMER' system (see Wenger, E., Artificial Intelligence and Tutoring Sys- 
tems. Los Altos, Morgan Kaufmann, 79-88, 1987) which provides an interactive, inspectable simulation of a steam 
propulsbn plant using computer graphbs. A user can manipulate a variable such as temperature and see the resuls 
on the rest of the system. There are also packages which perform complex mathematbal operations. For exampta^a 
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system identified by the trademark 'MACSYMA' (see advertising brochure from Symbolics, tnc.) performs algebra and 
trigonometry, calcutus and differentia! equations and numerica} analysis. By contrast, the Living Equations system 
handles single equations but provides a variety of related infomnation about the equations. For example, when exam- 
ining an equation on Poiseuille's law, a user can jump to a portion of a semantic net related to the changes in flow 

s observed when manipulating the law. Related infomriation which can be accessed includes motion sequences, graphics 
and pictures as wet) as text to provide a better understanding of the relationships observed, in addition, the Living 
Equations system is not limited to one domain such as steam plants, but can be applied across a variety of domains. 

The preferred SNETS system allows a user to create, display, edit, store and browse through semantic nets and 
to integrate semantic nets with other forms of viewing information. A semantic net is a knowledge representation which 

10 displays concepts and retattonships between them in a graphical form in which concepts are represented as nodes 
and relationships are represented as links between nodes (see, for example. Rich. E.. Artificial Inteiiiqence , New York: 
McGraw-Hill, 215-222. 1983). There are several semantic net buiMing tools available under a variety of names such 
as "SemNet* (see Fisher, K., Faletti, J., Thomton, R., Patterson, H., Lipson. J., and Spring, C, Computer-based knowl- 
edge representation as a too) for students and teachers, draft of paper. 1 987). 'Learning Too)' (see Kinko's Academic 

IS Courseware Exchange Spring 1988 Catalog, page 49. 1988), "NoteCards' (see Halasz, P.. Moran, T. and Trigg, R., 
NoteCards in a Nutshell. ACM, 45-52, June. 1987). "Unified Medical Language System* (Komorowski, H., Greenes, 
R., Ban-, C. and Pattiscm-Gordon, E., Browsing and Authoring Tools for a Unified Medical Language System, Harvard 
Medical School, Brigham and Women's Hospital, Boston, MA), and 'Neptune" (Delisle, N., and Schwartz, M., Neptune: 
a Hypertext System for CAD Applkjatk>ns, Technical Report No. CR-85-50. Computer Research Laboratory, Tektronix 

20 Laboratories. 1 986). 

All of these tools (including the SNETS system) altow a user to create semantic nets, to add and delete nodes and 
links and to browse through semantic nets. However, none of the systems provides the flexibility of the browsing ca- 
pabilities available in the SNETS system. The 'NoteCards' system referred to above allows navigation by following 
links and has a limited searching capability based on keyword matching. The "SemNet" system provides no capability 

2S to select sub-portions of the network. The system available under the name 'Learning Tool' provides only three link- 
types and limited database-type queries. The "Unified Medical Language System' provides a 'fish-eye' view of a node 
and its relatbnships. With this type of view, only closely related nodes are displayed. The "Neptune' system allows 
depth-first traversal and the ability to limit link types during a search. A major difference between these systems and 
the SNETS system is the availability of multiple methods of navigation in the SNETS system and the fact that views 

30 may be selected via a natural language interface. The SNETS system allows a user to view selected portions of a 
semantk: net such as 'causal links only," or 'only concepts related to thunderstomns." A user may request information 
related to a particular concept and may ask to view the concept along with all or a selected subset of link-types con- 
nected to the concept. The depth of links also may be specified. The user can also ask to see that portion of the net 
whbh connects two selected concepts. Again, in this case, the link-types of interest may be selected as well. Additk>nal 

35 methods of navigation include the ability to view all portk>ns of a semantic net reskiing In a single knowledge base or 
multiple knowledge bases. The preferred system also is able to recognize misspellings. 

The presentation modes described above are enhanced by the addition of a preferred User Modeling system which 
provides a set of data structures and a methodology to allow a system to monitor a user's responses and to modify 
interactbn with a user depending upon responses. For example, a system might determine that a user often requests 

40 information in a visual form and almost never requests a graphic form. When several forms are available, the system 
might present information initially in a visual form to match the user's typical preferences. The present User Modeling 
system also can be used to determine when to initiate interaction with a presentation mode and to select a mode which 
fits a particular context. For example, the User Modeling system might be used to examine an individual's user history, 
determine what concepts are not understood and select a presentation mode best able to commun icate those concepts. 

^ Within a particular presentation mode, the present User Modeling system can help make decisions such as the way 
in which information should be displayed to a particular user, and It can record relevant information about a user's 
activities while interacting with the presentatk>n mode. 

There has been much prior art in the area of intelligent tutoring (see, for example. Wenger. E.. Artificial Intelligence 
and Tutoring Systems. Los Altos: Morgan Kaufmann Publishers, 3-25 and 427-432, 1987). The prior art includes sys- 

so tems which perform user modeling and which use this information to teach skills to an individual. The present User 
Modeling system augments rather than competes with this prior art. That is, it provides a structure whk:h allows tech- 
niques developed in the prbr art to be combined with the present Intelligent Optical Navigation (ION) system. For 
example, the ION system could be used within a context of a tutorial program where some of the teaching techniques 
are defined by prior art but use the Space Explorer and Nearest Neighbor systems. In addition, the present User 

5S Mcxieling system provides a user modeling methodology specific to multi-media systems and to the ION system. This 
is a methodotogy which is not present in prior art. 

FR-A-2 607 284 describes a system in whk:h one can input expert system rules which can then be browsed by 
the user. The prior art system described by the patent permits the user to see on a system display the relatkxtshfis 
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betwsesn the rules o! the expert system. The purpose of the system described in the patent and the present tnventicxi 
are quite different. The prior art system is designed to help a user buifd and edit an expert system. The present invention 
is designed to help a user browse through large sets ot information including multi-media objects and allows one to 
search for objects and discover previously unknown relationships among concepts and categories within the informa- 
5 tton, and to display the discovered infonmation concepts artd categories on a display screen for user obsen/ation. 

Disclosure of Invention 

In accordance with the first a^ect of this invention there is provided a system as claimed in claim 1 herein. 

TO According to a further aspect of this invention there is provided a process as claimed in claim 11 herein. 

The present invention is a computerized infonmation presentation system for dynamically organizing information 
in order to present to a user previously unrecognized relationships among portions of the information and for presenting 
techniques for navigation through the information. The system comprises information description means for storing 
information comprising a plurality of concepts, the information description means comprising means for storing for each 

IS concept knowledge of allowable attributes for the concept and one or more of attributes, attribute values, and relation- 
ships among attributes and attribute values. The system further comprises categorizatk>n knowledge means for storing 
knowledge of criteria for placing the concepts into categories and context determrnatbn means for detemnining a cun'ent 
context based on system state. Mapping knowledge means are included for storing knowledge of mappings between 
a particular context and the presentatk)n of Infomnatlon. The system also includes dynamic categorization means for 

20 dynamically placing the concepts into categories for presentatbn using the categorization criteria, the current context 
and the knowledge of mappings and for displaying on a user screen selected concepts and categories. 

Brief Description of Drawings 

25 Figure 1 illustrates the teons used in drawings of the present applk:ation. 

Figure 2 represents the top level processes for the preferred ION system. 

Figure 3 schematically represents a hardware embodiment of the preferred system. 

Figure 4 illustrates interaction between the preferred ION system and preferred presentation mcxies. 

Figure 5 illustrates data structures used to represent information comprising a plurality of concepts. 
30 Figure 6 illustrates data structures and processes used to handle multi-media infonmation. 

Figure 7 Illustrates data structures for the preferred User Modeling system. 

Figure 8 illustrates a representation of an available activities data structure. 

Figure 9 illustrates an activity data structure. 

Figure 10 illustrates a concept network data structure. 
35 Figure 1 1 illustrates a concept data structure. 

Figure 12 illustrates a user-history data structure. 

Figure 13 illustrates data structures and processes used in the preferred User Modeling system. 

Figure 14 illustrates a set of preferred processes used for presentatbn mode selection. 

Figure 15 illustrates preferred user preference processes. 
^ Figure 16 illustrates a dimensioned-concept data structure. 

Figure 17 illustrates a preferred Space Exptorer system interface before navigation. 

Figure 18 illustrates a prefered Space Explorer system interface after navlgatton. 

Figure 19 illustrates statk: data structures for the preferred Space Exptorer system. 

Figure 20 illustrates a domains data structure. 
^ Figure 21 illustrates a knowledge structure data structure. 

Figure 22 illustrates a current-query data structure. 

Figure 23 illustrates a dimensions4o-expk>re data structure. 

Figure 24 illustrates general processes for the preferred Space Exptorer system. 

Figure 25 illustrates dimensioned-concept constraint processes. 
so Figure 26 illustrates a constraints user interface. 

Figure 27 illustrates a constraints sub-menu. 

Figure 28 illustrates dimensions organization processes. 

Figure 29 illustrates dimension presentation processes. 

Figure 30 illustrates navigatton-dimension processes. 
^ Figure 31 illustrates satellite change processes. 

Figure 32 illustrates a preferred Space Explorer system satellite user interface. 

Figure 33 illustrates general processes for the preferred Nearest Neighbor system. 

Figure 34a illustrates similarity-list construction processes. 
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Figure 34b illustrates top concept selection processes. 
Figure 35 illustrates simltarity generation and selectbn processes. 
Figure 36 illustrates similarity organization processes. 
Figure 37 illustrates a preferred Nearest Neighbor system user interface. 
5 Figure 38 illustrates similarity presentation processes. 

Figure 39 iilustrates navigation-similarity processes. 

Figure 40 illustrates perspective description and perspective organization data structures and processes. 

Figure 41 Illustrates perspective-concept data structures. 

Figure 42 illustrates preferred Focus system user Interface icons. 
10 Figure 43 illustrates attribute relationship processes and data structures. 

Figure 44 illustrates attribute-value data structures. 

Figure 45 illustrates perspective-concept data structures in detail. 

Figure 46 Illustrates general processes for the preferred Focus system. 

Figure 47 illustrates perspective constraint processes. 
IS Figure 48 illustrates perspective organization processes. 

Figure 49 illustrates perspective presentation processes. 

Figure 50 illustrates a preferred Focus system user interface for physical perspectives. 
Figure 51 illustrates a prefen^ed Focus system user interface for the preferred dispiay-two-concepts process. 
Figure 52 illustrates navigation-perspective processes. 
20 Figure 53 Illustrates an Image-concept data structure. 

Figure 54 illustrates a preferred Dynamic Image Scanner system knowledge t>ase. 
Figure 55 illustrates pivotal image-concept data structures. 
Figure 56 illustrates a pivotal-concept value data structure. 

Figure 57 illustrates general processes for the preferred Dynamic Image Scanner system. 
2S Figure 58 illustrates processes for generation and storage of graphical representations. 

Figure 59 illustrates image-concept constraint processes. 

Figure 60 illustrates image organization processes. 

Figure 61 illustrates image presentation processes. 

Figure 62 illustrates navigatbn-image processes. 
30 Figure 63 Illustrates a user Interface for the preferred Living Equatbns system. 

Figure 64 Illustrates data structures for the preferred Living Equations system. 

Figure 65 Illustrates an equation data structure. 

Figure 66 Illustrates a term data structure. 

Figure 67 Illustrates general processes for the preferred Living Equations system. 
3S Figure 68 Illustrates equation constraint processes. 

Figure 69 illustrates equation selection processes. 

Figure 70 illustrates equation display processes. 

Figure 71 Illustrates equation navigatbn processes. 

Figure 72 illustrates general processes for the preferred SNETS system. 
40 Figure 73 illustrates a prefen^ed SNETS system data structure. 

Figure 74 illustrates a preferred SNETS system user interface. 

Figure 75 illustrates a node data structure. 

Figure 76 illustrates a preferred SNETS system knowledge base. 

Figure 77 Illustrates a control-semantic-nets data structure. 
45 Figure 78 Illustrates net building processes. 

Figure 79 illustrates node addition and deletion processes. 

Figure 80 Illustrates link addition, link-type addition and link-type deletion processes. 

Figure 81 illustrates net display processes. 

Figure 82 illustrates net navigation processes involving menu selection and natural language processes. 
so Figure 83 illustrates net navigation processes Involving filtering processes. 

Detailed Description 

GENERAL INTRODUCTION 

55 

Figure 1 illustrates icons 999 which will be used throughout the present application to describe data structures and 
processes of the preferred ION system. In the prefen'ed embodiment, data structures 1000 are placed in rectangles, 
processes such as 1002 and 1004 are placed in ovals, a user 1014 Is portrayed by a circle, a user display 1012 ish 
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a ciouble rounded-rectangle, and a concept 1016 is in a rectangle. A concept 1016 may be thought of as a specialized 
data structure 1000 which may include a plurality of attribute 1017/attribute-value 1018 pairs enclosed in parentheses. 
In object oriented pr<^ramming terms, a concept 1016 may be considered to be an object, and an attribute 1017/at- 
tribute-value 1018 pair may be considered to be a slot and slot value respectively. An example of a concept 1016 is a 

5 'car/ which might have "color* equal to 'blue'. In the prefen^ed scheme, "car" would be presented in a concept 1016 
rectangle which includes an attribute 1017/attribute-vaiue 1018 pair with value expressed as (color blue). 

As illustrated in Figure 2. the preferred ION system dynamically organizes information 184 and presents the or- 
ganizatbn to a user 1014, allowing the user to browse through Information, and to view previously unrecognized rela- 
tionships among portions of the information. There is a plurality of ways to organize and browse through information 

10 184 in the preferred ION system; these are called presentation modes 166 (see Figure 2) and include the Space 
Expbrer system, the Nearest Neighbor system, the Focus system, the Dynamic image Scanner system, the Living 
Equations system, and the SNETS system. 

Referring to Figure 3, the preferred embodiment operates on a computer 68 comprising a processor 90 with as- 
sociated memory 92, the latter being subdivided for explanatory convenience into information storage 184 (which 

IS includes means for storing information comprising a plurality of concepts 1016 and is descn'bed more fully below), 
categorization knowledge 166 which Includes means for storing knowledge of criteria for placing the concepts into 
categories, and mapping knowledge 178 which includes means for storing knowledge of mappings between a context 
182 (see Figure 2) and the presentation of information. Those skilled in the art will recognize that computer memory 
92 may be embodied as a combinatk>n of Internal memory along with fixed and removable mass storage. Those skilled 

20 in the art will also recognize that appropriate user interface, input, and output means (not illustrated) are normally 
provided with such equipment. In the present application, a particular process and means for carrying out the particular 
process are typically equivalent, the means carrying out a particular process typically comprising processor 90, memory 
92 also being implemented In the case of information storage. 

Figure 2 illustrates dynamic categorization process 163 which is the general process of movement through the 

25 preferred ION system. In the preferred system, dynamic categorization process 163 provkies means for dynamically 
placing concepts 1016 into categories for presentation using categorizatkm knowledge 186 of criteria for placing con- 
cepts into categories, a context 1 82 determined by system state (context determination is described in the sectk>n on 
the User Modeling system), and mapping knowledge 178 of mappings between a context and the presentatkxi of 
information. Oynamk: categorization process 163 also includes means for displaying on a user screen the concepts 

30 1016 and the categories. 

One preferred process in dynamic categorization process 163 is presentation mode selection process 164. The 
preferred presentation mode selection process 1 64 is part of the ION general engine 922 (see Figure 4) and is activated 
whenever a user 1014 first approaches the system or completes interaction with a presentatkwi mode 1 66. Presentatkxi 
mode selection process 164 determines which presentation mode 166 to activate, as is described more fully in the 

35 section on the preferred User Modeling system. The remainder of the preferred processes work in a different manner 
in different presentatkxi modes, and they typk^ally are handled by the ION component engine 924 for the particular 
presentatk)n mode 166. As can be seen in Figure 4. the general flow of control in the preferred ION system is from the 
ION general engine 922 to an ION component engine 924 and back to the ION general engine 922. However, control 
is not fixed. Throughout the system, control in all preferred processes is guided by the nature of the user's interactions 

40 wrth the system. 

ION component engines 924 typically follow the general processes displayed in Figure 2. Preferred concept con- 
straint process 168 uses a context 182 to generate a presentation list of concepts 170. For example, it might be de- 
termined that a user is interested in informatk)n 1 84 on diseases but that the user is a beginner who does not understarxl 
subtle distinctions between diseases. Preferred concept constraint process 168 might collect information 184 about 
^ general categories of diseases, eliminating fine details, and place this information into a presentatbn list of concepts 
170. 

The next preferred step is category organization process 172, in which the presentation list of concepts 170 is 
organized for presentatk>n. In the preferred embodiment, both context 182 and presentatk>n nrKxie 166 determine the 
organization. For example, if the preferred Nearest Neighbor system is in use, organization may be based on conceptual 

so similarity among concepts 1016, and the nature of similarity definitions might depend upon the user's background. 
Concepts 1016 whtoh have been organized and their organization are next presented to a user 1014 in preferred 
concept display process 1 74. Preferably, the nature of the display depends on the context 1 82 and presentation mode 
166. For example, in the preferred Space Explorer system, the display includes a center dimensioned-concept 286 
(Figure 17) surrounded by a number of satellite dimensloned-concepts 282, 284, 288, and 290 whk:h represent an n- 

ss dimensional space. 

Foltowing concept display, a user 1014 typically is presented with the option to navigate through informatbn 164 
using preferred navigation process 176. For example, in the prefen-ed Dynamk: Image Scanner system, a user 1014 
may navigate by manipulating a graphic image whk:h bears a particular relatbnship to a concept 1016. The preferred 
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navigation process 176 includes means for selecting a navigation technique (navigation selection process 177) and 
means for using a navigation technique (navigation use process 1 79). Each of the processes (concept constraint 1 68, 
category or^ization 172. concept display 174. and navigation 176) ts described more fuHy in the sectbns on pres- 
entation modes 166. 

5 In all presentation modes 1 66, the preferred ION system organizes and presents information 184 to a user 1014. 

Figure 5 illustrates the preferred form for storage of information 184. In the prefen-ed embodiment. Information com- 
prises a pluralrty of concepts 1016. Examples of concepts 1016 such as toy" 1022 and 'ball* 1030 are illustrated in 
Figure 5. Concepts 1016 nr^y include information on attribute 1017/attribute-value 1018 pairs such as (similar weight 
size) 1028 and allowable attributes such as (allowable-attributes weight color size age) 1026. In the preferred embod- 

10 iment, an interpretation of this information 184 is that there is an object called a *toy", "toys* may have attributes 
•weight", "color", "size" and "age", and a "ball" has a "color" of "blue". 

In the preferred embodiment, information also includes relationships among attributes and attribute values. Rela- 
tionships among attributes 1017 may be represented in a number of ways. For example, (similar weight size) 1028 in 
concept 1022 indicates that attributes "weight" and "size* are similar to each other. Relationships among attribute- 
's values 1018 may be represented in a similar way For example, in concept 1036, (similar (young medium) (medium 
old)) 1 042 may be interpreted to mean that of allowable-values 1 040 "young*, "medium", "old", for concept "age" 1 036. 
"young" is similar to "medium" and "medium* is similar to "old". 

Another preferred way to represent relationships anrK^ng concepts 1016 may be seen in concept 1030, in which 
(type-of toy) 1031 indicates that a "ball" Is a type of "toy", thus representing a type/sub-type relationship between 

20 concepts 1030 and 1022. Typically, in a type/sub-typo relationship, the sub-type concept 1016 inherits slots from the 
type concept 1016. In the example, "ball" inherits the slots "color", "size", "age", and "weight" from "toy". This is an 
example of the types of relationships which may be represented in the preferred scheme, but many additional relation- 
ships may be included. For example, one might represent a "part-of" relationship or a "test-of " relationship in a similar 
fashion. The particular attributes 1017, attribute-values 1 01 8 and relationships represented typically depend upon the 

2S subject matter of interest. 

Within a concept 1016 in the preferred embodiment, it is often useful to include information 184 on different dis- 
playfonms 1082 which the concept 1016 might take (see Figure 6). It is useful in the present system to store multi- 
media representations corresponding to multiple sensory modalities of the concepts and methods to access the multi- 
media representations. For example, a concept 1016 such as concept 1046 of a "ball" may have the capability of betng 

30 displayed to a user 1014 both in graphic and textual form. Concept 1 046 illustrates some of the possible displayforms 
1082 such as textual 1050, pictorial 1052, graphic 1054, auditory 1056 and motion-sequence 1058, and the way in 
which they may be represented In the preferred ION system. In the preferred embodiment, information 164 stored In 
a slot such as motion-sequence 1 058 is infonration on storage of the displayform 1 082 (in this case a motion sequence) 
of the concept 1016, and there are additional slots such as text-method 1060 which include methods to access and 

^ display the displayform 1 082 to a user 1 0 1 4. The preferred way in which displayforms 1 082 are selected for presentation 
is described below in the User Modeling system section. 

In the preferred embodiment, an important part of information storage Is storage of categorization knowledge 186 
whfch includes information 184 on relationships arTX)ng concepts 1016 which allows the concepts 1016 to be placed 
into categories. Categorization knowledge 186 typically originates with a domain expert who may know, for example. 

4a that "disease A" and "disease B" are both caused by "weak mitral valves" but that their symptoms differ. Categorizatbn 
knowledge 186 typically is acquired in a systematic fashion from domain experts, and it plays an important role in 
representation of informatbn 184. Once it has been acquired, it can be input into the preferred ION system using the 
format for information storage described above. 

In the preferred ION system, context determination process 180 monitors system and user activity as the user 

^ interacts with the system. The purpose of preferred context determinatk>n process 180 is to generate a context 182 
comprising a system model of the user's goals and activities within system states in order to customize interactions 
with a particular user 1014. For example, context determination process 180 might determine what concepts 1016 a 
user 1014 does not understand, detennine what Informatbn 184 to present In order to fill in the gaps, and determine 
whk:h presentation nrK)de 166 to use to present the information. In the preferred embodiment, system and user infor- 

so mation is acquired and stored using the User Modeling system, and this system is described in the User Modeling 
system section. An important part of user nrxxJeling is the ability to map between a context 182 and presentatksn of 
inf onnation to a user. Mapping knowledge 1 78 preferably Is stored In user model 1 080 as a set of algorithms or methods. 
Storage of mapping knowledge 178 also Is described in the section on the preferred User Modeling system. 
Preferred systems and processes will be descnlDed in greater detail betow. 

55 

GENERAL DESCRIPTION AND DATA STRUCTURES FOR USER MODELING 

The prefen^ed User Modeling system provides a set of data stnictures and a methodology to altow a system to 
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monitor a user's responses and to modily interaction with a user depending upon responses. For example, a system 
might detemntne that a user 1014 often requests information in a pictorial form and almost never requests a graphic 
form. When several forms are available, the system might present informatics initially in a pictorial form to match the 
user's typical preferences. 

5 Data structures for the preferred User Modeling system are illustrated In Figure 7. In the preferred embodiment, 

there are several static data structures 91 4 required for the User Modeling system. One such data st njcture is a structure 
for available activities 636, which is illustrated in Figure 8. In the prefen^ed embodiment, the purpose of available 
activities 836 Is to store information about activities which are available in a system. For example, available activities 
836 could include an activity on the subject of cannula 840 (tubes which shunt blood to and from the heart during 

10 bypass surgery). In the example illustrated in Figure 8, there are several Space Explorer activities 838 available, one 
for a Space Explorer activity on the subject of cannula 840 and a second on the subject of diseases 842; there are 
also activities which are lectures 846 and tests 848. In the preferred system, many additional available activities 836 
could be added. 

In the preferred embodiment, an activity such as cannula activity 840 (which is a leaf node in the available activities 
IS 836 structure) has a corresponding activity data stnjcture 908 such as that illustrated in Figure 9. In the preferred 
system, an activity data structure 908 holds Information about concepts 1016 (see Figure 1 ) which are conveyed and/ 
or tested by an activity 636 and methods to call an activity 836, to monitor user interaction, and to provide mappings 
between user interaction and concept 1016 understanding. The following slots are included in the prefened activity 
data structure 908: name 850 which includes reference to a presentation mode 166 such as Space Explorer and to a 
20 subject matter such as 'cannula' 840, concepts-conveyed 852 which contains names of concepts 1016 which are 
conveyed to a user 1 014 by an activity 836 as well as an Indication of how well they are conveyed, testing-of 854 which 
contains concepts 1016 which are tested for user understanding by an activity 836, call-to-module 856 which contains 
a method to initiate an activity 836, monitoring 658 which contains methods to monitor user interaction during an activity 
836, and mapping 860 which contains methods for mapping from user interaction to user understanding of concepts 
2S 1016 

A concept network 910 such as that illustrated in Figure 10 Is another static data structure in the preferred User 
Modeling system. In the prefen'ed embodinnent, the purpose of a concept network 910 is to store informatbn about 
relationships among concepts 1 01 6, such as Information that concept 'A* is a sub-component of concept 'B', and concept 
'A' must be understood before concept 'B' can be understood. This could be very important information when a system 
30 Is used in a tutorial mode. In Figure 10, disease type 664 Is a sub-component of disease 862, general infomiatbn 870 
Is a sub-component of cannula 868, and selection 874 requires an understanding of both treatment 866 and cannula 
type 872. 

In the preferred embodiment, concepts 1016 In a concept network 910 have a concept data structure 916 such as 
that illustrated in Figure 11, which includes information on name 878, level 680 (which is an indicatk>n of skill level 

35 required to understand the concept 1016), and available-activity-list 882 (which contains pointers to activities 836 that 
convey information about the concept 1016). 

In addition to statlc-data-stmctures 914, there is an important dynamic-data-structure 916 called user-history 912 
(see Figure 1 2) in the preferred User Modeling system. The purpose of preferred user-history 91 2 is to hold information 
which is specific to an individual user and which relates to activities 836 in which a user has engaged in current and 

40 previous sessk>ns and about concepts 1016 whk:h a user cun'ently does or does not understand or to which a user 
has been exposed. In the preferred embodiment, informatk>n in user-history 912 can be used to individualize interactkxi 
with a user. The prefen'ed user-history 912 data structure (see Figure 12) Includes the following sk)ts: name 884 for a 
user's name, background 886 for information at>out a user's occupation or educational background, temporal-history 
888 which holds a list of activities 836 in the order in which a user completed the activities 836 (temporal sequencing), 

^ num-times-per-activity 890 which includes informatbn about the number of times a user participated in an activity 836 
(this includes information on activities completed in previous sessbns as well as those completed in a current sessnn), 
amount-time-per-activity 892 which holds information on the amount of time spent In an activity 836. num-requests- 
for-info-by-ty pe 894 which stores information on the number of requests for infomiatbn in different forms such as text 
and audio, concepts-studied 696 whfch lists concepts 1 01 6 which have been presented to a user, concepts-understood 

so 696 which holds concepts 101 6 whbh are understood by a user, concepts-not-understood 900 which holds concepts 
1016 whbh are not understood by a user, activities-in-current-sesslon 902 which holds infomiatbn on activities 836 
completed in a current session, cunent-activity 904 which holds the activity 836 in which a user is cun'ently engaged, 
and current-concept 906 which holds the concept 1016 currently viewed by the user The slots described in preferred 
user-history 912 are illustrative of the type of information which might be included in a system. User-history 912 couM 

ss be expanded to Incorporate additional infomnatbn about a user, if it were desired by a system devetoper. For example, 
one might want to keep track of the user's response time while Interacting with the system. 
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USER MODEUNG PROCESS DESCRIPTION 

As can be seen in Figure 2, context 182 (which includes user model 1080) may play a role in all preferred ION 
system processes. In the preferred ION system, some processes such as presentation mode selection process 164 

5 work outside of a particular presentation mcxie 1 66, and others such as navigation process 1 76 operate independently 
within a presentation mode 166, as is the case in the preferred Space Explorer and Nearest Neighbor systems; there- 
fore, it IS useful to think about mode-specific and nrtode-lndependent processes as separate entities. 

Figure 4 iliustrates a preferred general description of movement within the ION system which separates general 
from nnode-speclfic processes. In the preferred embodiment, a user can initiate interaction with the system by activating 

10 the ION general engine 922; a combination of user and system input can be used to call a particular ION system 
component by accessing an ION component engine 924 for the component (presentation mode) of interest; and inter- 
action can then proceed back and forth between the ION general engine 922 and an ION component engine 924 
through a combination of user and system input until interaction is complete. Within this general description, there 
preferably are several ways in which the User Modeling system can determine system-user interaction. By way of 

IS further examples, the preferred User Modeling system can be used with the ION general engine 922 to determine 
which ION component to call (presentation mode selection process 164); it can also be used along with an ION com- 
ponent engine 924 to detenmine the nature of the interactbn within a component. For example. It might be used to 
select an initial focal concept 146 for a Focus system session (see Figure 45) or to select the mode of presentation of 
a concept 1016; or it can be used with the ION general engine 922 to generate a tutorial interaction. These examples 

20 will be described more fully below. They are illustrative of the way in which user nKxieling informatbn can be used, 
but they are not exhaustive. 

It also Is important to describe the prefen'ed manner in which information 184 is input into user-histoiy 912. The 
preferred general process is illustrated In Figure 13. In the preferred embodiment, a user 1014 interacts with ION 
system 1084. user nrtodeling process 1086 monitors a user's activities and outputs information such as background 

2S data 886 which fonms a user model 1080. and the user model 1080 is stored along with other information in the user's 
user-history 912. Some of the data preferably is collected during interaction with a specific ION system module, and 
this coIlectk>n process will be described below in the appropriate sectbns. Other pieces of data typically are input only 
once, such as when a user first interacts with the ION system. For example, when a user first activates the preferred 
ION system, the ION general engine 922 asks for the user's name. If it Is not found in a user-history 912. the system 

30 preferably asks who they are and what their background is and places the appropriate informatbn 1 84 into a new user- 
history 912 data structure for the user. 

PRESENTATION MODE SELECTION PROCESS 164 

3S In the preferred ION system, whenever a user 1014 initiates an ION system session or completes an interaction 

with an ION component, the system and/or user must decide whether to initiate interaction with a new component, and 
if so which one. Figure 2 illustrates preferred presentatton mode selectbn process 164 at a general level of detail, and 
Figure 14 Illustrates the process in nDore detail. In the preferred embodiment, a user 1014 may make a selection directly 
via user mode selectbn process 926 with or without input from system mode selectkxi process 928. In the preferred 

40 embodiment, both user mode selection process 926 and system mode selectbn process 928 may interact with pres- 
entatbn mode relationship process 930 which determines relatbnships between presentatk)n modes 166. and the 
result of either process is selection of a presentatk>n mode 166. System mode selectbn process 928 may interact with 
preferred preference mapping process 1134 in order to incorporate user preferences into the selection process. 
An ION system devebper can allow a user total control over selection, in which case user mode selection process 

4S 926 can access available activities 836 to determine what activities are available and to present them to a user in menu 
form. The preferred User Modeling system would be involved minimally if this process were used. 

When system input is used for presentatkxi mode selectbn. preferred ION general engine process 922 accesses 
the user's user-history 912. As described above, ION general engine process 922 preferably asks for the user's name 
and determines whether a user-history 912 exists for the user. If It does not exist, the preferred system asks the user 

so 1 01 4 for information on background, places the informatkxi in a newly created user-history 91 2 and accesses available 
activities 836. The preferred ION general engine process 922 then determines whbh of the available activities 836 
match the user's skill level by comparing the user's background with the level 880 (see Figure 11 ) of the concepts 1016 
Involved in each activity 836. Activities 636 whbh match the user's skill level then typically are presented as optbns 
to the user in menu form. 

ss In the preferred embodiment, more complex methods of presentatbn mode selection may be used when a user- 

history 912 exists. For example, suppose that a user approaches a system for the second or third time. Preferred ION 
general engine process 922 can interact with preference mapping process 1134 to determine from user-history 912 
whether there are concepts 1016 whbh are not understood by accessing slot concepts-not-understood 900 in order 
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to select an activity 836 or set of activities 836 and 842 which address a concept 1016 which is not understood and 
which has not as yet been explored by the user and, therefore, does not appear in preferred slot temporal htetory 888. 

In the preferred ION system, there may also be information in a presentation mode 166 which indicates its rela- 
tionships to other presentation modes. For example, a Space Explorer system module may know that it relates closely 
s to a particular Nearest Neighbor system module. In that case, the relationship may be used to help select a presentation 
mode 166 once a current presentation mode is known. In the preferred embodiment, knowledge about relationships 
between presentation modes 1 66 is stored in the presentation modes themselves, and presentatbn mode relationship 
process 930 can use this information to hetp make a selection of a presentation nKxfe. 

Preferably, when a presentation mode 166 is selected, the ION general engine 922 places the name of the pres- 
to entatton nrKXIe in the user's temporal-history skn 888 and in the current-activity 904 sk>t and activates the presentation 
mode. 

USER MODELING WITHIN A PRESENTATION MODE 166 

IS In the preferred embodiment, a presentatkm mode 166 such as the Space Explorer system provides a user with 
a method of browsing through and dynamteally re-organizing infonnatbn. The pref en-ed User Modeling system works 
with a presentation mode 166 to help make decisions such as the way In whrch infomnation 184 should be displayed 
to a particular user 1014, and it records relevant information about a user's activities while interacting with the pres- 
entatkm nrvxie. Preferably, there is a great deal of flexibility in the type of information collected and interpreted by the 

20 User Modeling system, and procedures may vary between presentatbn modes 166. A few examples of the use of the 
User Modeling system will be presented below. These examples will be general because the preferred User Modeling 
system is meant to provide a stmcture to allow more specific procedures to be integrated with the ION system rather 
than a set of algorithms to generate tests, lectures or simulations in a particular domain. A person skilled In the art of 
tutoring, for example, can use the preferred User Modeling system to integrate a set of questions and answers on a 

2S partk:ular subject into the ION system, but the User Modeling system will not help to generate the questions and 
answers. 

One example of the use of the User Modeling system is to determine the displayform 1 082 (see Figure 1 5) to use 
when presenting information to a user. As described in the General Introductton Section, there are methods in the 
preferred ION system for storing multi-media representations of concepts 1016 which may include textual, pictorial, 

30 graphic, motion-sequence and auditory representations and methods of accessing the various representations. In 
many presentation nrKxJes 166, a user preferably is given the option to request further infomnation about a concept 
101 6 which is on display. It Is possible that there are multiple representations available for the requested informatksn, 
and the User Modeling system typically Is used to select an initial displayform 1 082 for the concept 1 01 6. The preferred 
ION component engine 924 for the particular presentation mode 166 could activate preferences mapping process 1134 

3S in order to check num-requests-for-info-by-type slot 894 in the user's user-history 912 and determine whteh dispby- 
fomns 1082 have been requested most frequently by the user in the past; this information typically Is used to deckle 
whKh displayform 1082 to present first. Preferably, as additional requests for displayforms 1082 are made by the user 
1014, the user-history 912 will be updated to maintain an accurate reading of displayform preferences. 

Figure 15 illustrates two additk>nal ways in which a user model 1080 may gukie interaction within a presentatwn 

40 mode In the present embodiment. One preferred way of using a user model 1080 Is to select a technique of navlgatkxi 
1136. For example, in the preferred Space Explorer system, a user may have an option between last* and Ihorough' 
methods of search while navigating through a multi-dimensional space. If desired, a sk>t for navigation-technques 
which hokJs the number of times different techniques had been requested could be added to the user-history 912. 
Then, when the Space Explorer system is called, preferences mapping process 1134 coukJ access the user-histoiy 

45 912 (which is part of preferred user nrKxJel 1080) to determine which technique of navigation 1136 to select. 

A second potential use of user nriodel 1 080 in the preferred embodiment is to select concepts 1 01 6 for presentation. 
For example, in the preferred embodiment when the Focus system is called it is necessary to select an initial focal 
concept 146. One preferred way of making a selectk^n is to use ION component engine process 924 for the Focus 
system to generate a list of potential concepts 1124 and then to use concept mapping process 1126 to access ttie 

so current-concept 906 stot of the user-history 912 and determine whether there Is a potential focal concept 146 which 
matches the current concept 906; if so, it can be selected. Another example of preferred use of a user nruxiel 1080 for 
concept selection is to constrain a list of concepts 1016 which will be presented to a user. In the preferred Space 
Expbrer system, for example, a user may request Information related to a concept 1016 on display using information 
access process 1120. In the preferred embodiment, information generation process 1122 may be used to generated 

ss list of concepts which bears a selected relationship to the selected concept. For example, if a car is displayed and a 
user asks for information on techniques of repairing the car, information generaticxi process 1122 typk:ally searches a 
knowledge base 715 (see Figure 1 9) for repair techniques. If ftve technkfues exist, potential concepts 11 24 will indUte 
the five techniques, and concept mapping process 1126 can remove any potential concepts 1124 which are not in- 
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derstocxi by the user, according to the user model 1080. 

As a user interacts with an ION component engine 924. information preferably is gathered for placement in a user- 
history 912. In the preferred embodiment, the particular information gathered will depend upon the context 182 and 
the presentation mode 166, Preferably, in all cases, num-requests-for-info-by-type 894 and current-concept 906 are 

s updated whenever infomnation is requested or a new concept 1016 is accessed; when interaction with a presentation 
mode 166 is completed, temporal-history 888, num-times-per-activity 890. activities- in-current-session 902, concepts- 
studied 696 and current-activity 904 preferably are updated. Other information may vary. For example, it may be ap- 
propriate to update amount-time-per-actlvity 892 in a simulation mode 844 (see Figure 8) but not in test mode 848. As 
mentioned above, an activity data structure 908 preferably includes information on methods for monitoring and inter- 

10 preting user interaction and would be used to determine when and how to update a user-history 912. 

TUTORIAL EXAMPLE 

One of the more sophisticated uses for the preferred User Modeling system is for tutorials. An example of the way 

IS in which the User Modeling system may be used for a tutorial will be explained in this section. Suppose that a student 
wishes to team about selection of cannula A tutorial activity could be added to the list of available activities 836 which 
contains methods to guide student-system interaction. Such a method might look first at a concept network 910 (Figure 
10) and discover that selection 874 requires understanding of other concepts 1016 such as cannula type 872 and 
treatment 866. Infonmation about difficulty level of each concept 1016 preferably is available in the concept's 1016 

20 concept data structure 916, and there may be informatk^n available in the user-history 91 2 about the student's back*, 
ground. Suppose that a student is a beginner and must be helped with all concepts. The tutorial can then start at the 
top of the concept network 910 with either cannula 668 or disease 862 and search for activities 836 which provkie 
information about those concepts. 

In the present example, general Information about cannula 870 may be found in a lecture 646 on 'what a cannula 

2S Is," and this might be a good place to start. The activity data structure 908 for 'lecture-what a cannula is' preferably 
wouM indicate how to activate the activity and might indicate that there is no user interaction during the activity, i.e., 
that the user just watches and listens. It might also indicate that following presentation of the "lecture,* the user-history 
912 should be updated to add "what a cannula is" to concepts-studied 896. The concept network 910 typically wouki 
indicate that cannula type 872 wouki be a reasonable next concept 1016 to pursue following completion of the lecture, 

30 and available activities 836 preferably would indk^ate that this concept 1016 can be explored using Space Explorer 
cannula activity 840 or Nearest Neighbor cannula activity 843. At this point, the tutorial may provkJe both options to 
the student and albw the student to select the activity 836. This process might continue until a sectbn on selectk>n 
874 is reached. Perhaps, following a lecture 846 on "how to place a cannula," the tutorial might decide to provide a 
test 848 on 'cannula selection." 

3S In the preferred embodiment, a test module 848 likely would have methods to provide questions and interpret 
answers to determine what concepts 1016 are and are not understood by the user. This information could be used to 
update concepts-understood 898 and concepts-not-understood 900 in the user-history 912 and sen^e as a basis (or 
selectbn of the next step. If, for example, the student still did not understand treatment 866, the tutorial might initiate 
a simulatbn 844 on 'surgery' in order to fill the gap. This is just one, simple example of use of the User Modeling 

^ system to provide a tutorial to a student Those skilled in the art will recognize that many other and more complex 
examples also are possible. 

GENERAL DESCRIPTION AND DATA STRUCTURES FOR SPACE EXPLORER 

^ The preferred Space Explorer system allows a user to organize a plurality of dimensioned-concepts 292 (see 

Figure 16) into an n-dimensional space such as the space Illustrated in Figure 17, and to navigate dynamically, intel- 
ligently, and visually through the n-dimensk>nal space. For example, suppose that there existed a plurality of dimen- 
sioned-concepts 292 where each dimensioned-concept 292 represented a patient record. Such a record might Include 
information on a patient's name 294, symptom 296, physician 298, diagnosis 300 and treatment 302. If there were 

so hundreds of records, it might be difficult to browse through them unless a structure such as that provided by the Space 
Expbrer system were provided. The present Space Exptorer system is dynamk: because a user may, contempor^ie- 
ously with browsing through informatk)n, re-structure the informatbn into an n-dimensional space and change the 
structure and presentation of the space without the need for reprogramming. 

An example of a Space Expk>rer system user interface 1012 in which the dimensioned-concepts 292 relate to 

ss patient characteristics is illustrated in Figure 17. In applying the preferred embodiment to this example, one patient 
record typk:ally can be conskiered to be a center dimensbned-concept 286. which may be surrounded by a number 
of satellite dimensioned-concepts 282, 284. 288. and 290. In the current embodiment, a satellite dimensioned-concept 
such as 282 differs from a center dimensionedKx^ncept 286 with respect to one characteristb or attribute 1017. For 
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example, compared to center patient 268, satellite 282 differs in sex, satellite 264 differs in diagnosis, satellite 268 
differs In treatment, and satellite 290 differs in physicfan. 

Using the preferred Space Explorer system, a user might navigate through conceptual space by changing an 
attribute 1017 of a center concept 266. For example, a user 1014 might change physician In center concept 286 from 

5 Smith to Katz, resulting In the n-dlmensiona) space being reconfigured to Incorporate the change (see Figure 16) so 
that the entire space now Includes patients of physician Katz Instead of Smith except for satellite 290. which Is the 
'physician satellite' and which, therefore, provides yet a third physician, Jones. 

The preferred Space Explorer system allows a user to constrain a space of desired dimensioned-concepts 292, 
determine how a space should be configured, and navigate through a space, typically by altering attributes 1017. In 

10 the preferred embodiment, there Is a one-to-one relationship between an attribute 1017 and a dimension. However, 
that need not be the case in general. For example, it would be possible to define a dimension such as 'general health* 
which Incorporates the attributes 'age', 'disease', and 'symptom' combined with a weighting scheme; in such an exam- 
ple, the dimension 'general health', rather than corresponding one-to-one with a single attribute, incorporates several 
weighted attributes 1017. In the examples illustrated in the Figures thus far, however, we will assume that a dimension 
incorporates only one attribute 1 01 7. 

There are both static and dynamic data structures in the preferred Space Explorer system embodiment. Figure 1 9 
illustrates prefen'ed se-static-data-structures 712 of the current embodiment. One preferred se-statlc-data-structure Is 
knowledge base 715 which relates to a subject of interest 71 3 such as cars, anatomy, or computers (see Figure 1 9). 
In the example illustrated in Figure 19, the subject of interest 713 relating to knowledge base 715 Is patients 718. 

20 A knowledge base typically Incorporates a plurality of dimensk^ned-concepts 292. In the current example, dimen- 
sioned-concepts include medical records for particular patients such as Brown 724 and Curtis 726. In the current 
embodiment, a particular dimensioned-concept 292 Is stored In a data structure (see Figure 16) whk:h includes a 
plurality of slots such as 296, each of which holds a dimension and the dimension's value for the dimensioned-ooncept 
292. Thus, for dimensloned-concept 292, slot 296 holds the dimensbn 'symptom* and the value "angina". 

2S Often, It Is convenient to group dimensioned-concepts 292 Into categories. In the current example as illustrated In 
Figure 19, patients such as Brown 724 and Curtis 726 are organized into categories or groups according to sex, and 
there are two groups, female 720 and male 722. The particular grouping is flexible. For example, we might deckie to 
have two sets of groupings, one by sex and a second by ethnic background. In the current embodiment, there can be 
as many or as few groupings as desired. 

30 Another se-static-data-structure 71 2 in the preferred embodiment is called domains 714 (see Figure 20). Typically, 
there is one domains 714 structure for a subject of Interest 713. In the preferred embodiment, domains 714 hokls a 
slot for each dimension and set of dimension values used in the subject of Interest 713. For example, the domains 714 
example illustrated in Figure 20 includes abnomial-ecg? slot 728 which holds values (no yes). 

Figure 21 illustrates a knowledge structure 7t6, a third se-statk:-data-structure 712 in the preferred embodiment, 

3S whk:h holds infomnation on dimensions of Interest in a donnain. For example, alphabetized-dimensions 734 typically 
holds a list dimensions whbh could be used by the Space Explorer system, membershlp*dimensk)ns 738 hokte 
class/subclass Infonrnatbn 184 used by the Space Explorer system such as the female 720 and male 722 categories 
illustrated in Figure 19, useful-dimensbns 746 holds dimensions currently active in the Space Explorer system, and 
rank-ordered-dimensions 742 provides a rank ordering of dimensions which could be used by the Space Explorer 

40 system. 

In the prefen'ed embodiment, there are data structures for dynamic data storage during execution of the Space 
Expkxer system. Typically, there Is a current-query 748 stnicture (see Figure 22) which holds information such as 
current-root-unit 750 where a current domain is stored, knowledge-structure-unit 752 whfch hokJs a pointer to a do- 
main's knowledge-stnjctures unit such as knowledge-structure 716, and standing-candidates 756 which holds dimen- 
45 sioned-concepts 292 which are active currently. I n the preferred embodiment, there Is a second dynamic data structure 
called dimensions-to-explore 270 which Is illustrated In Figure 23. Typcaily, dimenslons-to-explore 270 includes Infor- 
mation such as explorable-member-dlms 274 which holds dimensions whtoh could be explored In a parteular context. 
Further details about data stored in the data structures described above will be provkJed in the Space Explorer Process 
Description section folk>wing below. 

so 

SPACE EXPLORER PROCESS DESCRIPTION 

The preferred Space Explorer system follows the same general ION system processes described above and illus- 
trated In Figure 2 (concept constraint process 168, category organlzatbn process 172, concept display process 174 
55 and navigation process 176). IHowever, in the preferred Space Exptorer system, these processes are specialized for 
exploring an n-dimensional space. These specialized processes include dimensioned-concept constraint process 281. 
dimensk)n organlzatkxi process 283, dimension presentatk>n process 285, and navigation-dimension process 287 
(see Figure 24). In the current embodiment, a subject of interest 71 3 (Figure 1 9) is selected and concepts 1 01 6 which 
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are both related to the subject of interest 713 and of current interest to a user are accessed in dimensioned-concept 
constraint process 281 , concepts are organized into an n-dimensionaJ space during dimension organization process 
283, concepts are displayed to a user in a format similar to that illustrated in Figure 17 using dimension presentatbn 
process 285, and a user is given cations to navigate through an n-dimensiona) space in navigation-dimension process 
5 287. These preferred system process components will be described below. 

DIMENSIONED-CONCEPT CONSTRAINT PROCESS 281 

In the preferred embodiment of the Space Explorer system, the purpose of dimensioned-concept constraint process 
10 281 is to generate a dimensioned-presentation list 328 which contains dtmensioned-concepts 292 that can be present- 
ed to a user in an n-dimensional space during a particular Space Explorer system session. Preferred process 281 is 
illustrated in Figure 25. In the preferred embodiment, a subject of interest 71 3 is selected, and concepts 1016 related 
to the subject of interest 713 are collected (generate allowable concepts process 310), the concepts are organized 
(organize allowable concepts process 31 2), either a user places constraints on the concept list (user constraint process 
IS 316) or the system places constraints on the concept list (system constraint process 318), attributes 1017 which do 
not fit into current constraints are removed (attribute removal process 322 and attribute constraint process 320), di- 
mensioned-concepts which do not fit into current constraints are removed (concept de-selection process 324), dimen- 
sions which do not fit into current constraints are removed (dimension de-selection process 326) and a dimensioned- 
presentation list 328 is provided as an output. 

20 

GENERATE ALLOWABLE CONCEPTS PROCESS 310 

In the preferred embodiment, the purpose of generate allowable concepts process 310 is to generate a list of 
allowable dimensbned-concepts for the presentation nrxxie and the current context. In the current embodiment, the 

2S first step is to select a subject of Interest 713, and there are three ways of making a selectbn. First, the user 1014 
could request a Space Explorer system session on a subject of interest 713 directly For example, when the user 
completes an activity, a menu may be provided which Indicates all available activities. This menu may include one or 
more calls to the Space Explorer system as options, such as 'browse through houses'. The Space Explorer system 
may be configured to generate the list of subject of interest 713 options by accessing a global variable containnrtg 

30 pointers to potential domains. 

Second, a system such as a tutorial system may make a call to the Space Explorer system. For example, if in the 
mddle of a tutorial session the user misses a question about the types of house architectures which exist, the tutorial 
system can call the Space Explorer system on houses and ask the user to examine different house types with the 
Space Explorer system. There is preferably a set of rules which indicates when the Space Explorer system can and 

35 should be called (see sectbn on Presentatk>n Mode Selection) and a list of potential subjects of interest 71 3. When a 
user error is encountered, the rules and list of potential subjects of interest 71 3 may be consulted to determine whether 
to make a call to the Space Explorer system. 

Third, a related system preferably provides access to the Space Explorer system from other activities. If the user 
requests the Space Expbrer system, the requesting system preferably kx)ks at the current activity and determines 

40 whether there is a subject of interest 71 3 involved in the cun'ent activity which Is in the list of potential subjects of 
interest 71 3. If there is a subject of interest 713, It can be selected. If not, the user 1014 may select a subject of interest 
713 from the list of potential subjects of interest 713, or the Space Explorer system n^y select a default subject of 
Interest 713. 

In the present system as currently implemented, once a subject of interest 713, such as patients 718, has been 
^ selected, it is placed in the current-root-unit 750 slot of current-query 748 and is used to generate a list of albwable 
concepts by finding a data structure such as that in Figure 19 which has patients 718 as its root unit and then collecting 
a list of children which are leaves of the data structure such as Brown 724 and Curtis 726 in Figure 19. 

ORGANIZE ALLOWABLE CONCEPTS PROCESS 312 

so 

In the preferred embodiment, the purpose of organize alk>wable concepts process 312 is to organize albwable 
concepts according to their attributes and attribute values and to generate a list of attributes and attribute values. For 
the present, we will assume that attributes and dimensions are equivalent. In the present system, relevant informatbn 
for this step is stored in a knowledge structure 716 data structure for the subject of interest 713 selected during the 
55 generate allowable concepts process 310 described above. In the current embodiment, the list of dimensions is com- 
posed of a union of values from the membership-dimensions 738 and useful-dimensions 746 stots (see Figure 21), 
and each dimension has infomnation available about its attribute values. 
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USER CONSTRAINT PROCESS 316 AND SYSTEM CONSTRAINT PROCESS 318 

In the preferred embodiment, the purpose ot the constraint processes (316 and 318) is to limit the attributes 1017 
and/or attribute-values 1018 which will be active in a particular Space Explorer system session by allowing a user or 

5 the system to remove attribute values from the list of attributes and attribute values. Let us first consider the situation 
in which a user has control over the constraint process (user constraint process 316). It would be possible to present 
a user with a menu o1 attributes 1017 and attribute-values 1018 and to allow a user to select items which should be 
constrained. For example, a user might Indicate that only patients of physicians Jones, Harris and Johns<xi should be 
included. Figure 26 illustrates such a menu 329. A count 330 of dimensioned-concepts meeting current constraints is 

10 shown In the upper right comer of the menu. A user preferably can restrict any of the attributes 1017 in the left column 
by selecting 'choose' which brings up a sub-menu of attribute-values 1018 such as sub-menu 331 in Figure 27. Con- 
straint selectbn preferably ends when a user selects 'quit' from Figure 26. 

In the preferred embodiment, the Space Explorer system keeps track of selected constraints and presents only 
those options to a user which wake sense in a current context. For example, suppose a user indicated interest in only 

IS two physicians and both physicians belong to hospitals 'A' and 'B'. Now, If a user is selecting hospitals, only hospitals 
'A' and 'B* will be presented as options since the renrraining hospitals have no physicians of interest. 

System constraint process 318 works in much the same way as user constraint process 316 with the exceptkxi 
that constraints are selected by the Space Explorer system rather than a user In the preferred embodiment, if the 
Space Expbrer system is called from a context such as a tutorial, the tutorial may pass to the Space Expbrer system 

20 information on a current topic whk:h may be used to place constraints. For example, suppose that a user Is in the 
middle of a tutorial on selectbn of scalpels when the Space Explorer system Is called on the subject of surgbal Instru- 
ments. The Space Explorer system may wish to constrain the browsing space to that of scalpels. 

In the current embodiment, constraints are stored in the standing-constraints 258 slot of the current-query 748 
data structure and take a form similar to (sbt-value-equality size 20) which Indicates that size has an exact value of 

2S 20, (slc^-value-range length (0 15.3)) which Indicates that length has a range of values from 0 to 15.3. and (slot-value- 
set material (pvc vinyl)) which indbates that material can be either pvc or vinyl. 

ATTRIBUTE REMOVAL PROCESS 322 AND ATTRIBUTE CONSTRAINT PTOCESS 320 

30 In the current enrtbodtment, the purpose of attribute removal process 322 is to remove attributes 1017 which no 
longer have attribute values 1018 f olk>wing removal of attribute values In user constraint process 31 6 or system con- 
straint process 318. The Space Explorer system preferably checks to see whether there are any attributes 1017 whk:h 
have no remaining attribute values 1018 and removes them. Attribute constraint process 320 then preferably deter- 
mines whether constraints are placed on remaining attributes when one or nriore attributes have been renrK>ved from 

3$ the list by attribute rerruival process 322, and rennoves additional attributes based on the constraints. For exannple, if 
in the domain of 'hearts' an attribute 'disease' has been removed, one might want to also eliminate the attribute treat- 
ment*. One could devebp a set of rules determining relationships among attributes 1017 or store relationship informa- 
tion 184 in the domains 714 data structure for the domain and attribute. 

40 CONCEPT DE-SELECTION PROCESS 324 

In the preferred embodiment, the purpose of concept de-selection process 324 Is to generate a dimensbned- 
presentatbn list 328 by removing from a list of allowable concepts those dimensioned-concepts which have attributes 
101 7 or attribute values 1018 which have been removed prior to concept de-selection process 324 by the user constraint 
4S means and the system constraint means. In the preferred embodiment, since a dimensbned-concept 292 includes 
information on attributes 1017 and attribute values 1 01 8. a simple comparison of active attributes and attribute values 
and dimensloned-concept attributes and attribute values can be made to decbe which dtmensbned-concepts 292 to 
remove. In the current embodiment, the dimensioned-presentatbn list 328 is stored in standing-candidates sbt 756 
of the current-query 748 data structure. 

so 

DIMENSION DE-SELECTION PROCESS 326 

In the preferred embodiment, the purpose of dimension de-selection process 326 Is to remove, from a list of active 
dimensions, those dimensbns which do not meet current constraints, that is, process 326 uses the knowledge of 
ss mappings to remove dimensions for which there are no concepts in the dimensbned-presentatbn list. If there is a one- 
tOHDne relationship between attributes 1017 and dimensions, this process will have been completed following attribute 
removal process 322 and attribute constraint means 320. However, if there Is a several-to-one relatbnship between a 
dimension and a plurality of attributes 1017. dimension de-selectbn process 326 can determine whbh dimensions 



16 



EP0 436 663B1 



should be removed based on prior attribute removal. 
DIMENSION ORGANIZATION PROCESS 283 

5 Preferred dimension organization process 263 is illustrated in Figure 28. In the preferred embodiment, the purpose 

of dimension organization process 283 is to organize a dlmensioned-presentation list 328 into an n-dimenstonal space. 
The process of the current embodiment involves generating a list of attributes 1017 and attribute values 1018 to be 
used for concept organization (criteria determination process 332), prbritizing the list of attributes and attn'bute values 
(attribute prioritizatbn process 334), selecting a dimensioned-concept to be a conceptual center of the n-dimensional 

10 space (center concept selection process 336) and searching for a dimensioned<»ncept for each satellite dimension 
(dimension concept selection process 338). 

CRITERIA DETERMINATION PROCESS 332 

IS In the preferred embodiment, the purpose of criteria detenminatk)n process 332 is to use the knowledge of mappings 
to generate a list of attributes 1017 and attribute values 1018 to be used to organize dimensloned-concepts 292 into 
an n-dimensional space in a particular context. Generally, this involves generating a list of allowable dimensions and 
attribute values 1018 and then albwing the Space Explorer system or a user to select desired dimensions from the list 
of allowable dimensions. In the cun-ent embodiment, dimensions which remain active folbwing dimension de-selection 

20 process 326 are checked to see whether they are albwable dimensions. In the preferred embodiment, a dimenskx) is 
allowable if it has at least two attribute values 1 01 8. If there is only one attribute value 1 01 8, it would not make sense 
to attempt to explore the dimension, in the current embodiment, the list of allowable dimensions may then be presented 
to a user in the form of a menu, and a user is given the opportunity to select a set of dimenstons to explore; as imple- 
mented, the set may include from two to eight dimensions. It is also possible to albw the Space Explorer system to 

25 select dimensions. For example, If the Space Expbrer system is called from a tutorial and rt is known that the current 
user is naive about the domain being explored, the Space Explorer system may wish to limit the dimensions to those 
which fit into a student model of knowledge. 

ATTRIBUTE PRIORITIZATION PROCESS 334 

30 

The purpose of preferred attribute prioritization process 334 is to use the knowledge of mappings to generate a 
general prioritized list of attributes and attribute values from the list of attributes and attribute values generated by 
criteria determinatbn process 332. An important part of this goal Is to prioritize the list of dimensions to be explored. 
In the preferred embodiment, class/subclass dimensions such as female 720 and male 722 in Figure 1 9 are automat- 
^ ically given a higher prbrrty than dimensions which do not have a class/subclass relationship. In the current embodi- 
ment, rank orderings of remaining dimensbns may be found in the rank-ordered-dimensbns slot 742 in the knowledge 
structure 716 data structure. As implemented, these prbrities are combined to generate a final rank ordering of all 
dimensions to be explored, and the rank ordering is stored in the list-of-dimensbns 280 slot of the dimensions-to- 
explore 270 data structure. 

40 

CENTER CONCEPT SELECTION PROCESS 336 

In the preferred embodiment, the purpose of center concept selection process 336 is to use the knowledge of 
mappings to search through the list of dimensbned-concepts to select a dimensbned-concept 292 to be designated 

^ as an initial center concept of an n-dimensional space. Prbr to selectbn of dimensioned-concepts 292 for center or 
satellite positions, indexes are preferably created for dimensbns which will be explored. As implemented, an index 
includes an ordered list of attribute values 1018 for its dimension and a list of dimensioned-concepts 292 which match 
each attribute value. Indexes help to speed the searching process and may be stored in an indexed-standlng-sets skst 
278 of dimensions-to-explore 270. 

so In the preferred embodiment, a center concept is selected in the following way: 
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Idefine SELECT-CENTER 346 

(* select concept 1016 which will be initial center) 

5 find central attribute value 1018 for each dimension using its index 

for each dimension create a list of diniensioned-concepts 292 ordered by closeness to 
central attribute value for dimension 

if t here is an intersection of the first elements in each list 

then center concept is the first concept in the intersection 
^0 else combine first and second elements in one of the lists and look for intersection 

continue process until intersection is found! 

© 1988 3M Company 



IS DIMENSION CONCEPT SELECTION PROCESS 338 

The purpose of preferred dimension concept selection prcx:ess 338 Is to search through the dimenstoned-presen- 
tation list of dimensioned-concepts 328 to find a concept for each satellite In an n-dimensional space, where a satellite 
corresponds to a dimensbn to be explored. Dimension concept selection process 338 preferably Includes dimension 

20 definition process 340 for generating a satellite prioritized list of attributes 1017 and attrtoute values 1018 for each 
satellite by comparing the general prioritized list of attributes and attribute values to the conceptual center, dimension 
concept search process 342 for searching for a dimensioned-concept 292 for each satellite using Its prbritized list of 
attributes and attribute values, and method selection process 344 for allowing the system or user to select a search 
method to be used by dimension concept search process 342. 

2S The purpose of preferred dimension definition process 340 is to generate Infomnation required to perform a search 

for a dimensioned<concept 292. In the current embodiment, there are many types of search available; each perfonms 
a search for one satellite, and all of them are provided with the following information: the dimensioned-concept 292 
which Is the new center concept, the dimension of the satellite for which a search is being conducted, a list of dimensions 
for all current satellites, the list of dimensioned-concepts 292 which are currently available, a set of attribute values 

30 101 8 for each dimension ordered by closeness to a desired attribute value, a list of indexes for each satellite, a list for 
each satellite of the corresponding dimension, the attribute value of the center concept on that dimension, and the 
relationship between the new center and the previous center on that attribute value. This infomnation preferably is 
collected and sent to a search function. 

In the preferred embodiment, the purpose of dimension concept search process 342 Is to use the Information 

3S supplied by preferred dimension definition process 340 and a search method selected by method selection process 
344 to search for a dimensioned-concept 292 for each satellite in an n-dimensional space. Typically, there are many 
search methods available, a particular method is appropriate for a particular context, and some domain knowledge 
resides In the search method. This makes the preferred Space Exptorer system flexible and expandable. Since there 
are many potential search methods, we will only describe one method as an example. An example search method is 

^ as follows: 



(define EXAMPLE-SEARCH 352 

(♦ search for a dimensioned-concept 292 for a satellite and its dimension) 
select the closest attribute value 1018 for the target dimension 
find all dimensioned-concepts 292 with the current tar^get dimension value 
for each dimensioned-concept 292, see if it matches all other dimension values required 

for center concept 

if there is a match, retiun dimensioned-concept 292 

else remove the least important dimension and repeat until match is found or there 

are no dimensions left 

if no match is found, repeat with next closest attribute value) 

© 1988 3M Company 

The purpose of preferred method selection process 344 is to allow either the Space Explorer system or a user to 
select a search method for use in selection of dimensioned-concepts 292 for an n-dimensional space. In the current 
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system, any number and variety of search methods may be stored and used. It is preferred that, at any time during a 
Space Explorer session, a user may have the option to setect a new search method; a menu of options preferably is 
displayed and a user preferably is asked to select a desired search methcKJ. It also would be possible to allow a user 
to create a new search method which would then be added to a collection of methods and provided as an option. If 
5 the Space Explorer system is called from another module such as a tutorial, the system may decide to make its own 
selection of search method. A selection may be based on context or user model 1080. For example, if there is infor- 
mation indicating that a user prefers searches which are fast although slightly less accurate, the system may select a 
'fast search* automatically for that user. 

10 DIMENSION PRESENTATION PROCESS 285 

The purpose of preferred dimension presentation process 285 is to display to a user a plurality of concepts simul- 
taneously including a conceptual center concept and a plurality of satellite concepts which are organized by dimensions. 
Typically, this involves selecting a layout for the screen which is appropriate for the number of dimensions to be explored 

IS (layout selection process 348) and performing the display (layout process 350), that is, placing the conceptual center 
of the n<iimensional space on the user screen surrounded by satellites which each differ from the center along one 
dimension. These processes are illustrated in Figure 29. In the preferred embodiment, a layout selection is required 
because the layout of the screen is flexible and dynamic. For example, it is preferred that either a user or the Space 
Explorer system may choose a variable number of satellites for exploration. As implemented, there may be as few as 

20 two satellites and as many as eight and different numbers of items require a different layout scheme. Screen formats 
for different numbers of screen items preferably are stored and then retrieved during the layout selection process 348. 
It also would be possible to generate screens dynamically using a graphing placement algorithm. Generally, once a 
layout has been selected, layout process 350 places the center dimensioned-concept 292 in the spot designated as 
center spot on the layout, and each satellite dimensioned-concept 292 is placed in a separate spot designated for a 

2S satellite on the layout Figure 1 7 Illustrates a layout appropriate for a center concept and four satellites. Other layouts 
are also possible. It would also be possible to place satellites into satellite spots in an arbitrary order or to specify a 
particular order if desired. 

NAVIGATION-DIMENSION PROCESS 287 

30 

Preferred navigation-dimension process 267 is illustrated in Figure 30. In the current embodiment the purpose of 
navigation-dimension process 287 is to allow a user to navigate through an n-dimensional space by presenting the 
user with a technique of navigating through the dimensions. Typically, the process involves allowing the user to change 
the conceptual center of the n-dimensional space (center alteration process 354). generating a new prioritized list of 
OS attributes and attribute values for each dimension based on the new conceptual center (dimension re-specification 
process 356) and selecting new dimensioned-concepts 292 for each satellite by searching through the dimensloned- 
presentation list using the new prioritized list of attributes and attribute values for the corresponding dimension (satellite 
concept re^peciftcation process 358). 

40 CENTER ALTERATION PROCESS 354 

Preferred center alteration process 354 is Illustrated in Figure 31 . Typically, a new center 372 is selected by allowing 
the user to re-define an attribute value 1018 of a satellite (satellite-value change process 362), by allowing the userto 
select a satellite concept to be nfK>ved from a satellite to the conceptual center (satellite change process 360), or by 

^ allowing a user to select a conceptual center from the dimenstoned-presentation list (center direct change process 370). 
Satellite-value change process 362 provides one way of selecting a new center. It is easiest to understand the 
process by first becoming familiar with a typical user display 1012. Figure 32 illustrates one way of representing attribute 
value information 184 of a satellite 376 on a user display 1012. In the prefen-ed embodiment, the bottom of a satellfte 
typically has a panel with attribute value 1018 information such as name of dimension 382, relative positbning of the 

so satellite on the scale of potential attribute values 384. relative positioning of the center dimensbned-concept 292 on 
the scale of potential attribute values 386, an arrow pointing to the right 378 and an an-ow pointing to the left 380. 

In the current embodiment, there are three ways of selecting an attribute value 1018 for the satellite (select from 
satellite process 364): if a user selects the right pointing arrow 378, the dimension attribute value of the center moves 
one position to the right, and the satellite attribute value is re-set; if a user selects the left pointing arrow 380, the 

ss dimension attribute value of the center moves one position to the left, and the satellite attribute value is re-set; if a user 
selects the center of the panel between 380 and 378. a menu of all attribute values is presented, a user selects an 
attribute value from the menu which then becomes the new center attribute value, and the satellite attribute value is 
re-set. In the preferred ennbodiment, once a new attribute value has been selected, dimension re-deftnition process 



19 



EP0436 663B1 



366 is invoked to re-define the set of attribute values required for a center concept by generating a difference list of 
prioritized attributes and attribute values which define the difference between the conceptual center of the n-dimen- 
sional space and the new attribute value for the satellite. Typically, the process Is the same as that in attribute priori- 
tization process 334. in the current ennbodiment, the next step is center re-selection process 368 which parallels center 
5 concept selection process 336 in which a search is nnade for a conceptual center of the n-dimensional space using 
the difference list. 

Satellite change process 360 provides a second way of selecting a new center concept, tn the preferred embod- 
iment, a user has the option in satellite change process 360 to select a dimensioned-concept 292 whrch is currently 
attached to a satellite and indicate that the concept should be moved to the center position of an n-dimensional space. 
10 Center direct change process 370 provides a third way of selecting a new center concept In the pref en'ed embod- 
iment, it is possible to provide a user with a menu of dimensioned-ccHicepts 292 and to ailow a user to select one of 
the concepts for placement into the center position of an n-dimensional space. 

DIMENSION RE-SPECIFICATION PROCESS 356 

15 

The purpose of preferred dimension re-specification process 356 is to re-organize attribute values 1 01 8 for satel- 
lites following selectbn of a new center dimensioned-concept 292. In the current embodiment, the re-specification 
process is the same as that described in dimension definition process 340. 

20 SATELLITE CONCEPT RE-SPECIFICATION PROCESS 358 

The purpose of preferred satellite concept re-specification process 358 Is to select a new dimensioned-concept 
292 for each satellite following selection of a new center. In the current embodiment, the process Is the same as that 
described in dimension concept search process 342. 

25 

GENERAL DESCRIPTION AND DATA STRUCTURES FOR NEAREST NEIGHBOR 

The preferred Nearest Neighbor system allows a user to create and use definitions of similarity in order to organize 
and view a plurality of concepts 1016 according to their similarity. This feature of the present system is dynamic, i.e., 

30 it operates contemporaneously with the user's accessing the system and requires no reprogramming of the system in 
order to organize and view new concept similarities. For example, a user of the preferred embodiment might select a 
concept 1016 "car" and a definition of similarity which indicates that another car is similar to the first if it Is made by 
the same manufacturer, has roughly the same price and roughly the same engine size. The user might also Indicate 
that seating capacity should be considered but should be a lower priority in a similarity definition. Using these criteria, 

35 the Nearest Neighbor system could retrieve infonnation on several cars which are most similar to the Inftially selected 
car. An important component of the preferred embodiment is the ability of a user to create similarity definitions and to 
use a plurality of definitions in a single retrieval session. In the preferred embodiment, data structures 1000 for the 
Nearest Neighbor system overlap with those of the Space Explorer system. In particular, se-statlc-data-structures712 
(see Figure 19) are used by the cunent embodiment of the Nearest Neighbor system. 

40 

NEAREST NEIGHBOR PROCESS DESCRIPTION 

The preferred Nearest Neighbor system follows the same general processes described above for the ION system 
and illustrated in Figure 2 (concept constraint process 1 68. category organization process 1 72, concept display process 
^ 1 74 and navigation process 1 76). However, in the preferred Nearest Neighbor system, these processes are specialized 
for organizing concepts according to their similarity. These specialized processes include similarity-concept constraint 
process 387, similarity organization process 389, similarity presentation process 391 , and navigation-similarity process 
393 (see Figure 33). 

In the current embodiment, a top concept 410 (see Figure 34b) is selected and a similarity-presentation list of 
so similarity-concepts is generated in similarity-concept constraint process 387, the similarity-presentation list is organized 
by degree of similarity of concepts to the top concept 410 using a weighting in similarity organizatbn process 389, a 
plurality of concepts Is displayed simultaneously toa user, including a top concept 41 0 and a plurality of related concepts 
which are organized by similarity to the top concept 410 In similarity presentation process 391. and a user is presented 
with a technique of navigating through similarity-concepts by altering top concept 410 or similarity definition 398 (see 
ss Figure 35) during navigation-similarity process 393. An important aspect of the preferred embodiment Is the abili^tD 
create, modify and select similarity definitbns 398. These processes are illustrated In Figure 35. 
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CREATING AND MODIFYING SIMILARITY DEFINITIONS 

The processes Involved in creatton, modification and selection of sinnilarity definitions in the current embodiment 
are illustrated in Figure 35. In the creation process of applying the preferred embodiment, one may generate a plurality 

5 of similarity definitbns 390 (similarity generation process 395) by generating a list of selected attributes 1017 for use 
in a similarity definition (similarity attribute selection process 780). generating a list of selected attribute-values 1018 
for use in the similarity definition (similarity attribute value selection process 782), and generating a weighting of mem- 
bers of the list of selected attributes and the list of selected attribute-values for use in the similarity definition (similarity 
weighting process 784). In the preferred embodiment, a similarity definition may be selected (similarity selection proc- 

10 ess 392); either a user rnay be allowed to select a definition of similarity (user select process 394), or a system may 
use a particular context to select a similarity definition 398 for use in a Nearest Neighbor system session from among 
definitions of similarity 390 currently available to the Nearest Neighbor system (system select process 398). 

In the preferred embodiment, a user may dynamically (i.e. contemporaneously with accessing the system and 
without reprogramming the system) generate a new definition of similarity by specifying a new list of selected attributes, 

IS a new list of selected attribute-values and a new weighting (user define process 786), or may change the definition of 
similarity by altering the list of selected attributes, the list of selected attribute-values or the weighting (user change 
process 388). The preferred first step in allowing a user 1014 to define 786 or change 388 a similarity definition 398 
is to ask a user to select attributes of interest 781 (similarity attribute selection process 780) in the new similarity 
definition 398. As illustrated in Figure 20, in the subject area of patient records, attributes 1017 might Include abnormal- 

20 ecg?. age, allergy, diagnosis, physician, sex, symptom, and treatment. Imagine that a nurse is creating a definition of 
similarity 398 to access patient records similar to one particular patient record. Perhaps the nurse is interested in 
patients who had the same physician and diagnosis, but the nurse is less Interested in other patient characteristics. In 
this case, the nurse might select physician and diagnosis as the attributes of interest 781 . In the preferred embodiment 
of the Nearest Neighbor system, information on available attributes 1017 for a subject of interest 713. are stored in 

2S domains 714 for the subject of interest 713. and the Nearest Neighbor system can access the available attributes, 
present them to a user 1014 and ask the user to select attributes of interest 781 . 

The next step of the current embodiment is to albw a user to select attribute-values of interest 783 in a similarity 
definition 398 using similarity attribute value selection process 782. Once attributes of interest 781 have been selected, 
the preferred Nearest Neighbor system can access potential attribute-values 1018 for each attribute of interest 781 

^ using the domains 714 data structure for the subject of Interest 71 3. For example, attribute physician in Figure 20 has 
attribute-values Katz, Smith and Glaron. In the current embodiment, a user may be presented with attribute-values 
1018 and asked to select those values which are of interest in a similarity definition 398. Often, it may be the case that 
all attribute-values 1018 are of interest, and user define step 786 may be omitted. However, user define step 786 is 
included in the current embodiment because a user may want to indicate that one or more attribute^alues 1018 should 

35 have no bearing on a similarity definitk>n. Following below is an example illustrating the way in which this might work 
in the current embodiment. 

Suppose that the attribute value Katz Is removed from the attribute physician. Now, a patient record for one of 
Smith's patients is selected to be a top concept 410, and the Nearest Neighbor system is attempting to match the Smith 
patient to a patient of Katz. In the preferred embodiment, because Katz has been removed, there will be no credit given 

40 to a similarity match between the two records on the physician attribute. If Katz had remained as an altemative, it might 
receive a weighting, albert small. Indicating some similarity between the records in the current embodiment on the 
physician attribute. In other words, removal of an attribute-value 1018 in the preferred Nearest Neighbor system is 
equivalent to assigning it a weighting of zero. In the preferred embodiment, the default position is to include all attribute- 
values 1018 for an attribute 1017 but to allow a user to selectively remove one or more of the attribute-values. The 

^ result of user define step 766 of the preferred embodiment Is creatbn of attribute values of Interest 783. 

The third step of the preferred embodiment is similarity weighting process 784 during which a user 1014 may 
assign weightings to attributes of interest 781 and attribute values of interest 783 to be used in a similarity definitkxi 
398. Inthecunent embodiment, weightings of attributes 1017 are mandatory, and the sum of weightings for all attributes 
of interest 781 must equal 1 00. A user of the current embodiment may select weightings for attributes 1 01 7 in whatever 

so manner is desired as k>ng as each attribute has a weighting and the sum equals 1 00. There preferably Is more flexibility 
in weightings for attribute-values 1018, and there are a number of schemes which may be used. 

For example, it may be useful in some situations to assign full weight to an attribute 1017 if there is an exact match 
of attribute-values 1018 between a top concept 410 and another concept 1016 but to assign a default weighting such 
as 20% If there is not a match. In situations where there is a numerical ordering to attribute-values 101 8 as there would 

ss be for size, one may wish to devise a scheme in which the weighting is determined by dIvkJing the absolute value 
difference of top concept 41 0 and a second concept 1016 for the attribute 1 01 7 by the range of attribute-values available 
for the attribute. 

In yet a third situation, it may be desired to specify closeness between attribute-values 1018 which could then be 
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used to assign weightings during a nnatching process. For example, suppose that a two^tory house is more similar to 
a tudor than it is to a ranch style house. If top concept 41 0 Is a two-story house and a second concept 1 01 6 is a tudor. 
it may receive a relatively high weighting; if a second concept is a ranch style house, it may receive a smaller weighting. 
In the preferred emt)odiment. similanty weighting process 784 allows a user 1014 to specify a weighting procedure 
5 and specific weights desired for attribute-values 1018. In the cun'ent embodiment, the result of this process is a set of 
definitions of similarity 390. 

SIMILARITY SELECTION PROCESS 392 

10 The purpose of preferred similarity selection process 392 Is to allow a user or a system to select a similanty definition 
398 from among definitions of similarity 390. in many cases, a user may wish to select a definitton of similarity 390. In 
these cases, generally the Nearest Neighbor system may simply provide a list of available definitions and request a 
selection. In other cases, a separate system may be running when the Nearest Neightx^r system is called. In these 
cases, the catling system nr^ay wish to make the definition selection. For example, there may be several similarity 

IS definitions 390 for a patient records subject of Interest 713. Perhaps one definition is appropriate for a physician, a 
second for a nurse and a third for a medical records technician. If the calling system knows that a current user 1014 
is a nurse, it may choose to select the nurse definition rather than providing access to all three definitions. In either 
case, the output of similanty selection process 392 in the current embodiment is a similarity definition 398 which is 
stored in a gbbal variable which can be accessed during the remaining Nearest Neighbor processes which are de- 

20 scribed betow. 

SIMILARITY-CONCEPT CONSTRAINT PROCESS 387 

The purpose of preferred similarity-concept constraint process 387 is to select a top concept 410 which will be 

25 used as a basis for comparison and to construct a similarity-presentation list of similarity-concepts 404 to be compared 
with the top concept 410 (see Figure 34a). In the current embodiment, the first step of the process is to generate a 
simllarity-presentatlon list of similarity-concepts 404; either the system may be allowed to generate the similarity-pres- 
entation list using a particular context (system similarity-list construction process 400) or the user may be allowed to 
generate the similarity-presentation list (user similarity-list constructkm process 402). There are several options avaH- 

30 able for these processes. For example, If there Is a subject of Interest 71 3 whk:h Is of Interest to a user, the Nearest 
Neighbor system may wish to examine knowledge base 715 for the subject of interest 71 3 (see Figure 1 9) and place 
all leaf nodes Into the similarity-presentation list of similarity-concepts 404 (process 400). In other cases, a user may 
wish to restrict list membership (process 402). In those cases, similarity-concept constraint process 387 may be used 
to generate the similarity-presentation list of similarity-concepts 404 (which in this case would be equivalent to the 

35 dimensbned-presentation list 328). 

Once a similarity-presentation list of similarity-concepts 404 has been generated it may be presented In its entirety 
to a user to alk>w a user to select a top concept 410 using user top selection process 408. Another option is to allow 
another system to select a top concept 410 (system top-selection process 406) using a particular context. For example, 
in the preferred embodiment, the Nearest Neighbor system may be called from another activity Perhaps a user is 

40 studying cars using the Space Explorer system when the Nearest Neighbor system is called. In this case, the Space 
Expbrer system may pass the car which is currently the center concept to the Nearest Neighbor system to sen/eas 
atop concept 410. 

SIMILARITY ORGANIZATION PROCESS 389 

45 

In the preferred embodiment, similarity organization process 389 Is used to compare a top concept 410 to a 
of concepts 1016 In a similarity-presentation list of similarity-concepts 404 and to rank order the set of concepts ac^ 
cording to their similarity to the top concept 410 (see Figure 36). The first step in the current embodiment is to retrieve 
a similarity definition 398 for use in the rank ordering and access a current weighting for the selected similarity definition 

so (weighting retrieval process 412). As mentioned earlier, the similarity definiticxi 398 which has been selected during 
similarity selection process 392 has been stored in a gk)bal variable and can be retrieved at this time. The second slep 
In the current embodiment Is to use a similarity definition 398 to rank order the concepts (rank-ordering process 414). 
Preferred rank-ordering process 41 4 is used for comparing the top concept to addittonal similarity-concepts in tie 
similarity-presentation list using the current weighting, for using the comparison to generate a rank-ordered list of te 

ss similarity-concepts on a similarity scale, and for assigning a rank ordering to each similarity-concept. 

The preferred weighting process has been described earlier. Basically, in the preferred embodiment, each concept 
1016 is compared to the top concept 410 along the attributes of Interest 781 using appropriate weightings. The resui 
of the current process is a rank ordering of concepts 1016, where each concept is assigned a number from 0 to 100 
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indicating the degree of similarity between the concept and the top concept 410. 
SIMllJVRJTY PRESENTATION PROCESS 391 

5 Figure 37 illustrates a typical user display 1012 resulting from a call to the preferred Nearest Neighbor system. 

Generally, in the preferred embodiment, a top concept 41 0 ts displayed (428), several concepts 1 01 6 from the similarity- 
presentation list of similarity-concepts 404 are displayed (430) and rankings 431 for concepts are displayed, (n the 
preferred embodiment, the first step is ranking selection process 416 (see Figure 38) during which a user or the Nearest 
Neighbor system selects a ranking cutoff comprising a minimum ranking a concept 1016 must have in order to be 

10 presented to a user. For example, a user 1014 may decide that any concept 1016 below a 50% similarity ranking is 
not of interest. In other cases, all concepts 1016 may be of interest. 

The second step of the preferred embodiment is similarity-concept presentation process 418 during which a top 
concept 410 and the similarity-concepts which exceed the ranking cutoff are presented to a user 1014 with a layout 
similar to that in Figure 37. In the preferred embodiment, c^ly concepts 1016 which exceed the ranking cutoff will be 

IS presented, concepts will be presented in order of their ranking and only the number of concepts which can be presented 
in a readable fomi on the screen will be presented at one time. The number of concepts 1016 which can fit will be a 
function of the hardware used in the specific implementation. Typically, access to remaining concepts 1016 is provided 
with a scrolling option. Preferred ranking presentation process 420 is used to present the selected similarity deflnitk>n 
and the rank orderings for the similarity-concepts; a typical display is illustrated in Figure 37. 

20 

NAVIGATION SIMILARITY PROCESS 393 

In the preferred embodiment, there are two ways in which a user may navigate through a set of similarity concepts, 
by allowing a user to select a new top concept (top concept alteration process 422) and by allowing a user to select a 

2S new similarity definitk>n 398 (definition alteration process 424). These are Illustrated in Figure 39. A user preferably 
may select a new top concept 410 by choosing a concept 1016 currently on display and requesting that it be the new 
top concept 41 0 or by choosing to select a new top concept 41 0 from among the similarity-presentatk>n list of similarity- 
concepts 404. In the latter case, the process may be the same as that described in user top selection process 408. As 
previously indk:ated, a second way of navigating through concepts 1016 in the preferred embodiment is by selecting 

30 a new similarity definition 398. As shown In Figure 37 part 434, a user display 1012 preferably Includes a menu optton 
to see the current definition and a second option to select a new definition (434 on Figure 37). If 'new definition" is 
selected, preferably similiarity selection process 392 is activated. In the preferred embodiment, folbwing either top 
concept alteratbn process 422 or definition alteration process 424, similarity re-specification process 426 Is activated 
to re-organize and re-display the concepts 1016 using procedures equivalent to similarity organization process 389 

3S and similarity presentation process 391 to generate a new rank-ordering of similarity-concepts following selectton of 
the new top concept or the new similarity definition. Typically, navigation can then re-occur using navigation-similarity 
process 393. 

GENERAL DESCRIPTION AND DATA STRUCTURES FOR FOCUS 

40 

The Focus system allows a user 1 01 4 to view a real world object from a number of different perspectives 1 00 (see 
Figure 40). For example, the user might want to view a car from a number of positions and distances; the Focus system 
would make it easy for a user to select and change the position and distance. An important part of the preferred 
embodiment of the Focus system is the flexibility provkled in selectton of real world object characteristics and values 

4S whteh are of interest in a particular situation and which provkie access to a set of perspectives. A dynamic aspect of 
the Focus system is the ability to change the stoicture of viewing perspectives contemporaneously with system access 
and without the need for system reprogramming. For example, the user might decide to organize information by distance 
and position at one moment in time and to re-organize by position and functional use at another nrK>ment in time. The 
data structures which are used in the preferred embodiment to provide this flexibility as\6 dynamic character are illus- 

so trated in Figure 40. 

In the current embodiment, preferred perspective organization process 101 organizes perspectives 100 into a 
numberof perspective categories 102 such as physical perspectives 104 (perspectives which are organized byphysfcal 
relationships), and functional perspectives 110 (perspectives which are organized by functional relationships). Typk:ally, 
perspective categories 102 are sub-classes of the class of perspectives. Prefen-ed perspective-type organization proc- 
^ ess 1 03 organizes a perspective category 1 02 into a number of perspective-types 1 1 2 within the category. For example, 
physical perspectives 1 04 might Include perspective-types 1 1 2 such as distance 1 1 4, position 1 22 and type (nature of 
display such as graphic or picture) 124, while functional perspectives 110 might Include perspective-types 112 such 
as use-in-constmcti(m 126 and use-in-repair 128. In the current embodiment, perspective-types 112 correspond to 
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attributes 1017 and have a set of altowabie attribute-values 1016 (Figure 41). 

As indicated in Figures 41 and 42.. a perspective-type such as distance 114 also may have a pointer to a set of 
Icons 134 (stored In slot 116) corresfxjndlng to its adowablo attribute-values. Such Icons 134 are preferably images 
which appear on a user interface screen and which correspond to values or operations. For example, perspective-type 

5 distance 114 may be considered an attribute 1017 which has an attribute-values slot 118. allowable attribute-values 
1018 'close', 'near*, and W and a ptr to icons slot 116 which points to a set of icons 134 in Figure 42. with each icon 
in icon set 1 34 preferably corresponding to an allowable attribute value 1018. Icons may be used during concept display 
to allow a user easy access to information 184 about current attribute-values 118 and additional available attribute 
values. This allows the user 1014 to see where he/she Is in the space of available perspectives and to see options for 

10 movement. 

In the present system as Implemented, perspective description process 105 (see Figure 41) allows a particular 
instance of a perspective to be defined as a conjunction of attribute^alues 1018 where there is one attribute value for 
each attribute 1 01 7 or perspective-type 1 1 2 in a corresponding perspective category 1 02. For example, a perspective 
Instance such as 'a-physical-perspective' 1 30 may have a name 'close-top-picture* since it has the attribute-value 'close' 

IS for the perspective-type distance 114. the attribute-value *top* for the perspective-type position 122, and the attrbute- 
value 'picture' for the perspective-type type 124. 

A typical Focus system structure such as that in Figure 40 includes information about relatbnships among per- 
spective-types such as distance 114, position 1 22 and type 1 24, and among their attribute-values 1 01 8. In the preferred 
embodiment, relationships among perspective-types 112 and among attribute-values 1018 may be determined In part 

20 by a corresponding perspective category 102. For example, physical perspectives 104 may be described as a con- 
junction of attribute physical relatbnships among perspective-types 112 (such as distance 114 and position 122) and 
attribute-value physical relationships for these perspective-types using perspective physical relationship process 111 
while functional perspectives 110 may be described as a conjunction of attribute functional relationships among per- 
spective-types 1 1 2 (such as use-ln-construction 1 26 and use-in-repai r 1 28) and attribute-value functional relationships 

2S for these perspective-types using perspective functional relationship process 115. 

Figure 43 illustrates one way of describing relationships among attributes or perspective4ypes 112 using attribute 
relationship process 107. As mentioned above, in the current embodiment, there is a one4o-one relationship between 
attributes 1017 and perspective-types 1 1 2. For example, 'distance' may be both a perspective-type 1 1 2 and an attribute 
101 7. This need not be the case in general. For example, It would be possible to define a perspective-type 'view' which 

30 includes attributes 'distance' and 'position'. However, in the present example shown in Figure 43. perspective-types 
1 1 2 and attributes 1017 may be considered to be equivalent. Accordingly, in the current example, physical perspectives 
104 has a perspective-types slot 106 with a slot value 108 of ((distance position) type). One way of interpreting sbt 
value 108 Is that perspective-types 'distance*, lype'. and 'position' are physically related to each other and that 'distance' 
and 'posit bn' are more similar to each other than they are to lype'. 

3S One can represent relationships among attribute-values 1 01 8 in a similar fashion using attribute value relationship 
process 109 (see Figure 41). For example, perspective-type distance 114 may have an attribute-value sbt 118 with a 
slot value 1 01 8 of ((close near) far). One interpretation of sbt value 1 01 8 is that attribute-values 'close*, 'near*, and *iaf 
are physically related to each other and that 'close' and 'near* are nrK>re similar to each other than they are to far'. An 
altematlve representation of relationships among perspective-types 112 is illustrated in Figure 44. In this example, a 

40 perspective-type distance 1 36 has a close-to slot 1 38 with a slot value 1 40 of 'position' indicating that perspective-type 
'distance* is similar to perspective-type position, while a medium-close-to slot 1 42 has a sbt value 1 44 of 'type' Indicating 
that perspective-type 'distance' Is nrxxferatety similar to perspective-type *type'. 

In the preferred embodiment of the Focus system, all concepts 101 6 are perspective-concepts such as perspective- 
concepts 146, 158. 160. and 162 In Figure 45. In the current embodiment, some perspective-concepts such as 146 

4S are focal concepts, that is. concepts 101 6 which define a general category of real worid objects which have a number 
of perspectives and are of interest in a particular situation; others are related concepts such as 158, 160. and 162 and 
represent different perspectives of a focal concept. In the preferred embodiment, the Focus system typically has know!* 
edge about which perspective-concepts 146, 158, 160, 162 have the potential of being selected as focal concepts 146. 
For example, a focal concept may be 'car* or 'heart*. There are at least two ways of representing focal concept infor- 

so matlon. One way Is illustrated in Figure 45. If there are many potential focal concepts. It may be preferable to have a 
focal-concept-p sbt 150 In a perspective-concept 146 wh'ch indicates whether the perspective-concept has the po- 
tential to be a focal concept. Altemath/ely. there may be a gbbal variable which hobs pointers to potential focal con- 
cepts. This alternative may be preferable when the percentage of perspective-concepts which may be focal concepts 
is low. 

55 Typically, a focal concept 146 has knowledge about Its related concepts 158, 160, 162. If the number of related 

concepts Is small, It may be preferable to store pointers to the related concepts in a sbt in the focal concept, such as 
related-concepts slot 156, because access then will be rapid. If the number of related concepts is large, it may be 
better to represent related concepts as sub-classes of the focal concept, particularly if there are frequent updates to 
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the system. 

A focal concept 146 may also contain infomnation 184 about perspective categories 102 and perspective-types 
104. 110 which are appropriate for the focal concept. This information may be represented as slots such as allowable 
perspective categories slot 152 and allowable perspective types slot 154 in Figure 45. 

5 

FOCUS PROCESS DESCRIPTION 

The preferred Focus system follows the same general processes described above for the ION system and illus- 
trated in Figure 2 (concept constraint process 168, category organization process 172, concept display process 174 

10 and navigation process 176). However, in the preferred Focus system, these processes are specialized for organizing 
concepts according to perspectives. These specialized processes include perspective constraint process 185, per- 
spective organization process 189, perspective presentation process 21 6 and navigation-perspective process 1 91 (see 
Figure 46). In the current embodiment, a focal concept 146 Is selected and perspective-concepts related to the focal 
concept are accessed during perspective constraint process 185, concepts 1016 related to the focal concept are or- 

15 ganlzed during perspective organization process 1 89. a perspective of the focal concept Is displayed during perspective 
presentation process 216, and the user 1014 is given the option to navigate through related perspectives during nav- 
igation-perspective process 191. For example, a focal concept might be that of a copying machine. Related concepts 
might include different views of the copying machine. A view from the front might be displayed initially with a menu 
which allows the user to change the position or distance from the machine. These system components will be described 

20 below. 

PERSPECTIVE CONSTRAINT PROCESS 185 

In the preferred embodiment, the purpose of perspective constraint process 185 is to generate a perspective list 
25 of perspective concepts 202 for display Preferred process 185 is sub-divided Into concept-perspective selection proc- 
ess 187 which is used to generate a perspective list of perspective-concepts which represents different perspectives 
of a focal concept, perspective category selection process 1 96 which is used to select a perspective category and 
perspective-type selection process 1 88 which is used to generate a list of perspective-types by selecting one or more 
perspective-types from the perspective category. 
30 Basic perspective constraint process 165 for the current embodiment is illustrated In Figure 47. Within preferred 
concept-perspective selection process 187, a focal concept is selected (process 192) and a list of related concepts 
which are related to the focal concept is generated (process 1 94). In preferred perspective category selection process 
196, a perspective category is selected. In preferred perspective-type selection process 188, a list of allowable per- 
spective-types which map c^to the focal concept is generated for the perspective category by selecting one or more 
35 perspective-types from the perspective category (process 198), the perspective-types are constrained by either the 
Focus system or the user (process 200) and concepts 1016 which are not related to the remaining perspective^ypes 
are removed from the list of related concepts to create the perspective list of perspective concepts 202. In the current 
embodiment, the output of perspective constraint process 185 Is a perspective list of perspective concepts 202. 

40 FOCAL CONCEPT SELECTION PROCESS 1 92 

In the current embodiment, the purpose of focal concept selection process 192 is to select a real world object 
which has a number of perspectives and is of interest to the user. In the current embodiment, there are three methods 
of focal concept selection. First, the user could request a Focus system sessbn on a real world object directly For 
4S example, when the user completes an activity, a menu nrtay be provided which indicates all available activities. This 
menu may Include one or more calls to the Focus system as options, such as 'expbre the aorta*. The Focus system 
may generate the list of focal concept options by either accessing a global variable containing pointers to potential 
focal concepts or by searching through perspective concepts and selecting those which have a value of "yes* in Ihetr 
focal-concept-p slot 150. 

50 Second, a system itself may make a call to the Focus system. For example, if, in the middle of a tutorial sessioa 

the user misses a question about the parts of a car, the tutorial system can call the Focus system on the model of car 
and ask the user to examine the car with the Focus system. There is preferably a set of mles which indicates when 
the Focus system can and should be called (see section on Presentation Mode Selection) and a list of potential focal 
concepts. When an error is encountered, the rules and list of potential focal concepts may be consulted to determine 

5S whether to make a call to the Focus system. 

Third, a related system preferably provkfes access to the Focus system from other activities. If the user requests 
the Focus system, the requesting system preferably looks at the cun-ent activity and determines whether there is a real 
world object involved in the cun'ent activity whk:h is in the list of potential focal concepts. If there is an object, it can be 
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selected as the focal concept, if not, the user may select an object from the list of suitable objects, or the Focus system 
may select a default object. 

RELATED CONCEPT SELECTION PROCESS 194 

5 

Typically, once a focal concept has been selected, the Focus system generates a list of related concepts which 
represent perspectives of the focal concept which could be made available to the user. If the focal concept has a 
related-concepts slot such as related-concept slot 156 in Figure 45. it may be accessed to generate a list of related 
concepts. An alternative method of generating a list may be used if the focal ccxicept has links to sub-classes of related 
10 concepts. In this case, the links may be folk)wed to generate a list of related concepts. For example, a 'heart' focal 
concept may have 'heart-type' links to perspective concepts 'adult-heart', and 'child-heart', which, in turn, have 'views' 
links to perspective concepts 'adult-heart-front-view*, 'adult-heart-side-view*. and so on. Typically, the 'leaves' of the 
hierarchy woukJ be collected and placed in the list of related concepts. In the example above, 'adult-heart-front-view* 
might be included in the list, but 'adult-heart' might not because it is not a leaf node. 

15 

PERSPECTIVE CATEGORY SELECTION PROCESS 196 

In the current embodiment, the list of related concepts generated by related concept selection process 1 94 contains 
all perspective concepts which are related to a focal concept. It is possible that some of the perspective concepts may 

20 not be of interest or may not be appropriate in a particular context. In the preferred embodiment, perspective category 
selection process 196 begins the process of removing perspective concepts which are not desired. Typk:aity, the first 
step Is to restrtot the perspective concepts to those belonging to a partrcular perspective category such as 104. If there 
is a user model 1080 of the user, the model can be checked to see whether there is a preference for a particular 
perspective category such as 1 04. If there Is a preference, it can be used. If nothing is known about the user, the Focus 

25 system may check the focal concept to see if there is a default perspective category and use the default. It Is possible 
that there is not a default perspective category but that there is a standard perspective for the focal concept. In this 
case, the standard perspective may be accessed. Because typically a perspective instance such as 130 comes from 
only one perspective category 104, it may be used to select the perspective category 104. 

30 PERSPECTIVE-TYPE GENERATION PROCESS 1 98 

The purpose of preferred perspective-type generation process 198 is to generate a list of allowable perspective- 
types which map onto the focal concept where allowable perspective-types are constrained by the perspective category 
104. Typically, a perspective category 104 has a number of altowable perspective-types such as 114, 122, 124. not all 

3S of \A^ich are desired in a particular context. In the preferred embodiment, once a perspective category 1 04 has been 
selected, albwable perspective-types 112 are accessed via perspective-type generation process 198 and then con- 
strained via perspective-type constraint process 200. As illustrated in Figures 40 and 43. a perspective category 102 
such as physk^al perspectives 1 04 may have a perspective-types slot 1 06 which contains a list of albwable perspective- 
types for the perspective-category 108. In this case, the list may be accessed directly Physical perspectives 104 may 

40 also have perspective-types links to its perspective-types 112 which may be followed to generate a list of perspective- 
types 112. 

PERSPECTIVE-TYPE CONSTRAINT PROCESS 200 

^ In the preferred embodiment, the purpose of perspective-type constraint process 200 is to generate a list of desired 

perspective-types by selecting one or more perspective-types from the list of altowable perspective-types. Typkally; 
folbwing perspective-type generation process 1 98, there is a list of perspective-types. Using perspective-type con- 
straint process 200. there are several potential methods of determining whether it Is desirable to remove items from 
the list. If there Is a user model 1080, it may be consulted to determine whether there is a preference for certain 

^ perspective-types 112. If there is a preference, it may be used to constrain perspective-types 112. If there is no user 
model 1080, it wouki be possible to allow the user to select perspective-types 112 directly or to include all perspective- 
types 112 rather than constraining them. Once a constrained list of perspective-types has been obtained, it typfcaOy 
is compared with the list of related concepts generated by related concept selection process 194 to remove any per- 
spective concepts which do not fit into the remaining perspective-types 112. In the preferred embodiment, the com- 

^ parison typically Is made In the following way: 
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( define CONSTRAIN-CONCEPTS 123 

(* remove cx>ncepts 1016 which have no counterpart in the perspective-type attribute 

5 ''St) 

let attribute-list be the list of attributes 1017 corresponding to the perspective-types 112 

in the constrained list of perspective- types 112 

let perspective list of perspective concepts 202 be empty 

for concept in the list of related concepts 

let concept-attribute be the list of attributes for which the concept has attribute^ 

values 1018 

If t here is an attribute in concept-attribute which is also in attribute-list 

add the concept to perspective list of perspective concepts 202) 

© 1988 3M Company 

In the preferred embodiment, a list of attributes 1017 corresponding to perspective-types 112 in the constrained 
list of perspective-types is constructed, a list of attributes which have attribute-vatues 1018 in a perspective concept 
Is generated, and, if any of the concept attributes is In the list of attributes for perspective-types, the perspective concept 
20 Is placed in a perspective list of perspective concepts 202. 

PERSPECTIVE ORGANIZATION PROCESS 189 

The general purpose of preferred perspective organization process 189 is to organize the perspective list of per- 
25 spectlve-concepts according to the selected perspective-types (see Figure 48). In the present system, prior to per- 
spective organization, a perspective category 102 and a number of perspective-types 112 have been selected, and a 
perspective list of perspective concepts 202 has been generated. The specific purpose of perspective organization 
process 1 89 in the present system is to generate a list of attributes 1017 and attribute values 1 01 8 using the perspective 
category 1 02 and perspective-types 112, organize the attributes and attribute values, and use the organization to select 
30 for display a perspective concept from the perspective list of perspective concepts 202. Typically, a list of allowable 
attributes 1 01 7 and attribute values 1 01 8 for the selected perspective-types is generated using the knowledge of nnap- 
pings (criteria determination process 204), the knowledge of mappings is used to generate a prbritized list of attributes 
and attribute values from the list of altowable attributes and attribute values (attribute prbritizatksn process 206), a 
standard perspective is selected for the selected perspective-types (standanil perspective selection process 208) and 
3S a concept 1016 matching the standard perspective is retrieved using the prioritized list of attributes and attribute values 
(search method process 210). 

CRITERIA DETERMINATION PROCESS 204 

^ In the current embodiment, the purpose of criteria determinatbn process 204 is to generate a list of attributes 1017 

and a list of attribute-values 1018 for use in selection of a perspective concept for display. Generally, the input to 
perspective organization process 189 is a list of perspective-types 112 which is output by perspective-type generatk>n 
process 198. In the current embodiment, there is a one-to-one correspondence between perspective-types 112 and 
attributes 1017, so a list of allowable attributes may be generated directly from a list of perspective-types 112. As 

45 indicated in Figure 40, a perspective-type such as distance 114 typically has a set of allowable attribute-values 1018 
which can be accessed once the perspective-type 112 is known. Generally, this is the process used to generate a list 
of allowable attribute-vatues. 

ATTRIBUTE PRIORITIZATION PROCESS 206 

so 

In this stage of the preferred process, the list of allowable attributes 1017 and attribute values 1018 generated by 
criteria determination process 204 is prioritized to help in the selection of a perspective concept. The prioritizatkxi can 
be pre-stored or generated dynamically. A pre-stored prbritization might be stored as a set of similarity relatbnships 
among attributes and among attribute values as described above in the 'General Oescriptbn and Data Stmctures* 
55 sectk>n and illustrated in Figure 40. It also would be possible to generate a prioritizatbn dynamically. The user couU 
be presented with a list of attributes 1017 artd asked to place them into categories based on similarity The same could 
be done for attribute values 1016. The Indivklualized similarity rankings could be stored in an individuaPs user model 
1080 and accessed whenever the user 1014 called the Focus system on the same focal concept. 
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STANDARD PERSPECTIVE SELECTION PROCESS 208 

When tho Focus system is called on a partrcular focal concept 1 46, it is necessary In the preferred system to select 
a perspective such as 130 for the initial display. There are several ways of doing this. A standard perspective 151 may 
5 be stored v\nth a focal concept 146 and accessed directly If a user nrKxiel 1080 Is available, the model can be checked 
to see if there is a preference for a perspective 130, and the preference can be used to determine the standard per- 
spective 151 . If the Focus system Is called from a current activity, the system In control checks to see if there is a 
perspective 1 30 which matches the concept 1016 involved in the current activity. This process will be described f uther 
in presentatbn mode selection process 164. 

70 

SEARCH METHOD 210 

In the preferred emtx>diment, a standard perspective 151 is selected by standard perspective selection process 
208. Typically, a standard perspective 151 Is defined as a conjunction of attribute-values 1018, one for each applicable 

IS attribute 1017. Generally, once a standard perspective 151 has been selected, search method 210 searches the per- 
spective list of perspective concepts 202 for a perspective concept which matches the standard perspective's attribute- 
values. In the Focus system as implemented, if there is a perspective concept 146 with all attribute-values 1016 match- 
ing, it Is selected and attribute prioritization process 206 is skipped; if there Is not a direct match, the prioritization 
described in attribute prioritization process 206 is used to gradually relax constraints until a match is found. There are 

20 at least two ways of relaxing constraints. The first way Is more general and might be used when the percent of per- 
spectives 130 which have matching perspective concepts 146 is high (that is, when the space of perspective concepts 
146 Is dense). With this method, a prioritization scheme such as that mentioned above can be combined with a method 
to generate a match. An example of a method is the following 



Idefine FIND-MATCH 212 

(• find a concept 1016 to match a perspective) 

rep eat until nmtch is found 

^ let hp-attribute be the highest priority unused attribute 1017 from standard 

perspective 151 

find highest priority attribute value for hp-attribute 
mark hp-attribute as used 

let other athibutes be the attributes from standard perspective 151, excluding hp- 
^ attribute 

select highest priority attribute value 1018 for each member of other-attributes 
if conjunction of all attribute values does not match a concept in perspective list of 
per spective concepts 202 

gradually select lower priority attribute values for the other-attributes starting 
^ with the lowest priority attribute 

until a match is found or there are no unused attribute values left] 

© 1988 3M Company 

^ If the space of concepts 1016 is sparse for a particular focal concept 146, that is. rf there are many potential 

perspectives 130 for which there are no matches, it might be preferable to search for a perspective 130 using an 
algorithm which has been specialized for the focal concept 1 46. For example, suppose that one wants to view the aorta 
from a number of vantage points, altering distance, position and type of view (picture, MRI, graphic). If there are 6 
potential distances, 6 potential positions and 3 potential types of view, there would be 6x6x3, or 108 potential perspec- 

so tives 130. It might be the case, however, that only 12 of those perspectives 1 30 are available in the Focus system. In 
this case, a general search through the perspective concepts 146 may be less efficient than an algorithm which moves 
more directly to the closest perspective concept 146. An example of such an algorithm appears below. 
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[define ALCORiTHM-FlND-MATCH 214 

find closest match using algorithmic approach) 

if p osition value of standard picture equals inside 
match is inside-graphic-near 

(* there is only one concept 1016 which has a value of inside for position 122) 

if type value of standard picture equals motion-sequence 
match is back-motion-far 

(* there is only one concept which has a value of motion for type 124) 

if p osition value of standard picture equals front or top or bottom 
hold position constant and find closest type 

if n o match can be found by varying type 

hold position constant and vary type and distance 114 until closest match is found 
(♦position is a higher priority than type or distance, distance is higher than 
type-so keep position constant and try to keep distance constant while type is 

varying, if no match is found, vary both type and distance)! 

<D 1988 3M Company 

if this second approach is desired, a searching algorithm can be stored with the focal concept 146 and accessed 
when needed. 

PERSPECTIVE PRESENTATION PROCESS 216 

In the prefen^ed embodiment, the purpose of perspective presentation process 216 (see Figure 46) is to display 
to a user one or more perspective concepts 146 and their perspectives 1 30 organized by perspective-type. A perspec- 
tive concept 146 typically is displayed as a picture or a graphic drawing while a perspective 130 typically is displayed 
as a set of labels or icons representing a conjunction of attribute-values 1018 such as 'close-top-picture". A process 
of perspective presentation 216 for the preferred embodiment is depicted in Figure 49. In the current embodiment, 
perspective presentation process 216 can result in a display of two perspective concepts 146 simultaneously using 
display two concepts process 218, or one perspective concept 146 representing a perspective, its perspective IX 
displayed as a conjunction of attribute values, and relationships between the selected perspective-types, using concept- 
perspective presentation process 220, perspective display process 222, and perspective relationship presentation 
process 224 respectively. 

Figure 50 illustrates a display of a single perspective 130. Typically, in the display of a single perspective 130, a 
user can see the perspective concept 228 itself, the perspective 230 (conjunction of attribute-values 1018) of the 
perspective concept 228. and the relationship of the current attribute-values 1018 to the other attribute -values 1018 
available for the perspective category 1 02 and perspective-types 1 1 2. There are several methods which could be used 
to display the perspective 130 and perspective relationships. In the current embodiment, a mixture of icons and tesxt 
is used to present a menu for each perspective-type 112 and its attribute-values 1018, and the values representing 
the perspective 1 30 on display are highlighted (see Figure 50). In this example, the perspective-types 1 1 2 are position, 
distance and representation type. Alternatively, one could display the perspective 130 by only providing labels for the 
attribute-values 1 01 8 of the perspective 1 30 itself or by providing menus of all attribute-values 1 01 8 consisting of text 
only, with text for the perspective's 1 30 attribute-values 1016 highlighted. 

In the present system, there is a second display option for situations in which a user wishes to view more than one 
perspective-concept 1 46 simultaneously. An example of this option is in Figure 51 . In this situation, only the perspective- 
concepts 232, 234 are displayed. However, a user may access further infomnation 184 about any perspective-concept 
such as 232 or 234. including its perspective 130, by requesting the information on an available menu 236. 

NAVIGATION-PERSPECTIVE PROCESS 191 

As a result of perspective presentation process 216, a user 1014 typically is able to view one or two perspediife 
concepts 146. In the prefen-ed embodiment, the purpose of navigation-perspective process 191 is to atbw a user Id 
select and view additional perspective concepts 1 46 by presenting the user with a technique of navigating through Hie 
perspectives. Preferred navigation-perspective process 191 is illustrated in Figure 52. One method of navigation is 
provided by preferred perspective displayform alteration process 238 which albws navigation by changing disptayfonm 
1062 by, for example, allowing the user to determine whether one or more concepts will be displayed simultaneous^ 
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There are three additiona! methods of navigatbn which constitute preferred perspective manipulation process 239; 
these include perspective-category alteration process 240 which allows the user or the system to change the perspec- 
tive-category 102. perspective-type alteration process 242 which allows the user or the system to generate a new list 
of perspective-types 112. and perspective atteratbn prcxess 244 which allows navigation by changing perspective 
5 1 30 Jn the preferred embodiment, perspective manipulation process 239 also includes categoiy-based alteration proc- 
ess 246 which allows selection of a new perspective to match a change in perspective-category within a particular 
context, type-based alteration process 248 which allows selection of a new perspective to match a change in perspec- 
tive-type within a particular context, and direct perspective alteration process 250 which allows the user or the system 
to select a new perspective by selecting a new attribute value. These processes will be described further below. 

w 

PERSPECTIVE CATEGORY ALTERATION PROCESS 240 

In the current embodiment, a Focus system display includes a menu allowing a user to change perspective cate- 
gories 102. In this implementation, if a new perspective category 102 is selected, the preferred Focus system keeps 

IS the same focal concept 146 and related concept list but uses processes equivalent to the remainder of perspective 
constraint process 185 described above (type-based alteration process 248) to generate a new list of perspective- 
types for the new perspective category 102. A new perspective 130 and a new perspective-concept 146 then can be 
selected using processes equivalent to the perspective organizatbn process 189 described above (perspective re- 
organization process 252 which allows dynamic re-organization of the perspective list of perspective-concepts following 

20 a change In the perspective-category, perspective-types or perspective, perspective re-setectlon process 254 which 
allows selection of a new perspective to match the dynamically reorganized perspective list, and concept re-selection 
process 256 which allows selection of a concept to match the new perspective). Typically, the perspective concept 1 46 
then is displayed using the perspective presentation process 216. 

2S PERSPECTIVE-TYPE ALTERATION PROCESS 242 

In the current embodiment, a Focus system display typically includes a menu allowing a user 1014 to change 
perspective-types 112. If a user 1014 asks to change perspective-types 112, a menu of available perspective-types 
for the current perspective category 102 generally is presented. Typically, after new perspective-types 112 have been 
30 selected using type-based alteration process 248, processes equivalent to those described above are used to generate 
a new prioritized list of attributes 1017 and attribute-values 1018 (perspective re-organization process 252), select a 
standard perspective (perspective re-selection process 254), search for a new perspective concept (concept re-selec- 
tion process 256) and display the perspective concept using perspective presentation process 216. 

3S PERSPECTIVE ALTERATION PROCESS 244 

As seen In Figure 50, in the preferred embodiment, a typical Focus system display includes a menu of available 
attributes 1017 and attribute-values 1018 for a perspective category 102. Generally, a user 1014 can change the 
perspective 130 by selecting a new attribute-value 1018 for any attribute 1017. In the present Focus system, if a new 
<o perspective 130 is selected using direct perspective alteration process 250, the Focus system searches for a new 
perspective concept 146 using a process equivalent to search method process 21 0 (concept re-selection process 256) 
and displays the perspective concept 146 using perspective presentation process 216. 

PERSPECTIVE DISPLAYFORM ALTERATION PROCESS 238 

4S 

In the current embodiment, a Focus system display typically Includes a menu selection to allow a user to change 
displayform 1082. One type of displayform 1082 might be a form in which one perspective concept 146 is viewed at a 
time. Another displayform 1082 might be a form in which more than one perspective concept 146 can be viewed at 
one time. If a current displayform 1082 is that for display of a single perspective concept, a user 1014 preferably can 

so choose to view rrtore than one perspective concept 1 46 simultaneously In the preferred system, if this option is selected, 
a pointer to the current perspective concept is stored in a global variable temporarily and considered to be item one. 

Typically, a user then is given standard menus such as those depicted in Figure 50 to change perspective category 
102, perspective-type 112 and perspective 130. Generally, a user 1014 has the optkxi to change perspectives using 
the menus as often as desired. When a second perspective concept 146 has been displayed which is of interest, a 

ss user 1014 of the preferred system can indicate that the second perspective corrcept 146 is ot interest, and a pointer 
to it is stored dynamically In a global variable. The process can continue until all perspectives 1 30 have been selected. 
Generally, the appropriate perspective concepts then will be displayed simultaneously using display two concepts 
process 218. 
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If a muftipte display is current, a user preferably can choose to view any item on the muHipie display using the 
single display format by simply selecting the item and invoking perspective presentation process 216. 

GENERAL DESCRIPTION AND DATA STRUCTURES FOR DYNAMIC IMAGE SCANNER 

5 

The preferred Dynamic Image Scanner system allows a user to navigate through a plurality of inriage-concepts 
604 (see Figure 53) by manipulating graphical representations 616 of image-concepts 604. The present Dynamic 
Image Scanner system is dynamic, i.e., contemporaneously with the user's browsing through information, the user 
may manipulate graphical representations of information, and the system uses these graphical changes to restructure 

10 information within the system and to present the restructured data to the user for viewing. For exannple, a user who Is 
interested in "chairs* might be presented with a graphical representation 616 of a 'standard chair*. The user might 
manipulate the image graphically to indicate a chair of a greater width. The preferred Dynamic Image Scanner system 
might interpret the manipulation and use it to access information 184 about a chair which matches the new graphical 
representation 616; perhaps the new chair might be a love seat In the preferred embodiment, the Dynamic Image 

IS Scanner system Interprets changes in graphical representations 616 and uses the interpretation to access information 
184 about an image-concept 604 which matches the new graphical representation 616. 

The preferred data structure for image-concepts 604 (see Figure 53) includes information 184 about the name 
606, sub-components 607 which represent portions of the graphical representation 616 which may be manipulated by 
a user 1014 (in the *chair* example, sub-components 607 might include ■height" and "width*), values 608, 610 for sub- 

20 components 607, a pointer 61 2 to a graphical representation 61 6 of the image-concept 604, and other-infonmation 61 4 
which may be available about the image-concept 604. For example, other-infomrtation 614 might include Information 
about price, location of a picture of the item, and typical use for the item. 

Image-concepts 604 in the current embodiment typically are organized Into a knowledge base 556 as illustrated 
In Figure 54. The top of the hierarchy 558 typically includes an innage-concept 604 which depicts a general topic such 

2S as 'chairs*, and the leaves such as 564 and 566 are particular image-concepts 604 which fall under the general topic. 
At any particular point in time, in the preferred embodiment one Image-concept 604 is selected to be a pivotal Image- 
concept 572 (see Figure 55). Preferably, there are several pieces of infomiation 184 available about a pivotal image- 
concept 572. For example, sub-components 607 of the preferred embodiment include information about potential val- 
ues 590, components of a graphical representation 616 which may vary (components-to-vary 592), and methods which 

00 may be used to alter a component graphically (method-to-alter 594). 

In the preferred Dynamic Image Scanner system, Individual values 590 for a sub-component 607 include informa- 
tion on the value's definition 600 and related-concepts 602 (see Figure 56). In the preferred embodiment, definitkxi 
600 is used to provide an indication of a range of values or items whrch may be included in a category for a value 590. 
For example, "nonral height' might include heights ranging from 2 to 4 mm on a display screen, although any type of 

35 definltk)n 600 can be included (it need not be numeric). Related-concepts 602 is optbnal in the preferred embodiment; 
if desired, it includes pointers to image-ccxicepts 604 which fall within a definition 600 for a value 590. For example, 
"tall height* might Include related concepts "high chair" and "counter seat*. Since the data structure for lmage<x»ncepts 
604 In the preferred embodiment includes values 608, 610 for sub<omponents 607 (see Figure 53), this Informatkxi 
need not be stored separately in a values 590 data structure; however, one may choose to do so to increase speed of 

40 response of the system during run time. 

DYNAMIC IMAGE SCANNER PROCESS DESCRIPTION 

In the preferred embodiment, a major task involves generating and storing graphical representations 61 6 of image- 
^ concepts 604. Once this task is complete, the preferred Dynamk: image Scanner system folbws the same general 
processes described above for the ION system and illustrated in Figure 2 (concept constraint process 168, category 
organization process 172, concept display process 174 and navigation process 176). However, in the preferred Dy- 
namic Image Scanner system, these processes are specialized for organizing concepts according to graphical repre- 
sentations. In the preferred embodiment, these processes Include image-concept constraint process 603 which is used 
so to generate an image-presentation list of image-concepts 640 whk:h may be presented, and to select a pivotal image- 
concept 572, innage organization process 605 which is used to generate an organization among the image-ooncepte 
604 based on relationships among the image-concepts' 604 graphteal representatkxis, image presentation process 
609 during which a pivotal image-concept 604 and its graph k: representation 61 6 are displayed to a user, and navlgatk)n 
image process 611 whk;h is used to present the user with a technique of navigating through the image-concepts 604 
ss by allowing a user to manipulate a graphical representatk>n 61 6 in order to access a new image-concept 604. 
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INITIAL PREPARATION OF PIVOTAL IMAGE-CONCEPTS 572 

As previously Indicated, the preterred system has been implemented so that a pivotal Image-concept 572 Is stored 
with Infomnation on rts sub-components 607. sub-components 607 include infomnation on values 590, components-to- 
5 vary 592, arui rrtethod-to-alter 594, and values 590 Include information on definition 600. In the preferred embodiment, 
this information must be input to the Dynamic Image Scanner system by a system developer. Figure 56 illustrates the 
process involved. 

In the preferred first step (graphical representation process 61 8), graphical representations 61 6 for Image-concepts 
604 are generated and stored using any standard graphical interface. Preferably, the second step Is decomposition of 

10 a graphical representation 616 into a series of sub-components 607 which may be nnanipulated by a user (decompo- 
sition process 622). Typically, this step requires Icnowledge of Image-concepts 604 and the parts of an image-concept 
604 which are both Important conceptually and easy to manipulate. Typically, the particular graphic interface used will 
dictate the nature of the interaction between a system developer and the system as a system developer labels sub- 
components 607 on a graphical representation 616. The preferred last step is allowable change process 626 which Is 

15 used to generate a list of allowable changes for sub-components 628 comprising changes which the user may rmke 
to the sub-component in a particular context. Preferably, this includes informatbn about the nature of a manipulation 
which may be made by a user (which is stored in components-to-vary 592) and a method to allow a user to make such 
a change (which preferably is stored In method-to-alter 594). Any standard graphical manipulation technique may be 
utilized in allowable changes process 626. 

20 

IMAGE CONCEPT CONSTRAINT PROCESS 603 

Figure 59 illustrates preferred image constraint process 603. The preferable first step is selection of a pivotal image 
concept 572 by either a user (user select pivotal process 630) or the system (system select pivotal process 632) in 

2S which the system uses the knowledge of mappings and a particular context to make a selection. In the preferred 
Dynamic Image Scanner system, a pivotal image-concept 604 corresponds to a real world object which may be rep- 
resented graphically. Preferably a user can request a Dyanamic Image Scanner system session on a real world object 
directly. For example, when the user completes an activity, a menu may be provided which indicates alt available 
activities. This menu may include one or more calls to the Dynamic Image Scanner system as options. The Dynamic 

30 Image Scanner system may generate the list of optbns by selecting a head node in each Dynamk: Image Scanner 
system knowledge base 556. 

A system itself may make a call to the Dynamic Image Scanner system. For example, if, in the middle of a tutorial 
session, a user misses a question about the difference in the amount of cun^ature in the roofs of two cars, the tutorial 
system can call the Dynamic Image Scanner system on "cars' and ask the user to explore car differences graphically. 

35 There is preferably a set of rules which Indicates when the Dynamic Image Scanner system can and shoukJ be called 
(see section on Presentation Mode Selectbn) and a list of potential pivotal image-concepts 572. The rules and list of 
potential pivotal image-concepts 572 typically may be consulted to determine whether to make a call to the Dynamic 
Image Scanner system. 

After 8electk)n of a pivotal image-concept 572, the preferred next step is related image process 636, which gen- 
40 erates a list of related concepts which bear a graphical relatbnship to the pivotal image concept 572. Typically, a pivotal 
image-concept 572 Is the top of a knowledge base 556 (see Figure 54). and a list may be generated by collecting the 
leaves of the tree such as 564, 566 and 568. If the pivotal image-concept 572 is a leaf of a tree in a knowledge base 
556, the preferred related image process is to include all leaves except the leaf which is the pivotal image-concept 572. 
In the prefen^ed system, the next step is list constraint process 638, during which an image-presentation list is 
^ generated by removing Image-concepts 604 that do not match a user model 1080 from candidates for the Image- 
presentation list of image-concepts 640 (the list of related concepts), if there is no user nrrodel 1080, this step maybe 
excluded. If a model does exist, it may be used to constrain the canddates. For example, if the Dynamic Image Scanner 
system is called from a tutorial in which a user 1014 was studying "Fords', it nr^ay be preferable to exclude miage- 
concepts 604 which are not 'Fords'. Often, this may be done by examining a knowledge base 556. In the chair example^ 
50 "adult chairs* may be eliminated by selecting only leaves emanating from child 562. In the preferred embodiment, an 
image-presentation list of image-concepts 640 is generated as a result of list constraint process 638. 

IMAGE ORGANIZATION PROCESS 605 

^ The purpose of prefen-ed image organization process 605 is to organize the image-presentatbn list of image- 
concepts 640 based on relationships among the image concepts' graphical representations 616. The preferred process 
is illustrated in Figure 60. In the preferred embodiment, the basis of organizatbn is comparison of values 590 of each 
image-concept 604 sub-components 607. Preferably, input to the process includes a pivotal image^oncept 572. and 
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a first step is to generate a list of pivotal image-concept 572 sub-components 607 (sub-component access process 
642). As tndk:ated above, sub-components 607 preferably are stored in a data structure for a pivotal image-concept 
572. Therefore, in the preferred embodiment, sub-components 607 may be accessed directly. 

The next step of the preferred embodiment is sub-component organization process 644 during which a sub-tist of 
image-concepts 646 is generated for each sub-component 607, the sub-list comprising the Image-concepts which 
relate to the pivotal-concept sub-component; in this process, each member of the sub-list has the same value 590 for 
the sub-component K)7. The purpose of this step of the preferred embodiment is to reduce searching time during 
navigatbn. As indicated above, a system developer may choose to store related image-concepts in a related-concepts 
slot 602 in a value 590 data structure. If such previous storage has been carried out, a sub-list may be generated by 
simply accessing related concepts from the related-concepts slot 602 and removing image-concepts which are not in 
the image-presentatioi list of image-concepts 640. If there was no previous storage, a sub-list may be constructed by 
accessing sub-component 607 values 590 from an image-concept's 604 data structure. 

IMAGE PRESENTATION PROCESS 609 

During preferred image presentation process 609. a pivotal image-concept 572 and its graphical representation 
616 are displayed to a user. The preferred process is illustrated in Figure 61. Display pivotal image-concept process 
648 typically displays an image-concept 604 to a user. There is a great deal of flexibility in the nature of the display 
For example, the name 606 may be displayed alone, or information stored in the other-Information slot 614 may be 
displayed. Some of the informatbn may be displayed with access provided to additional infonmatron or all Information 
may be displayed simuftaneousty. Typically, this will depend in large part on the nature of information stored in the 
other-information slot 614. 

An image-concept's 604 graphical representation 616 is displayed during display pivotal image-concept's graphical 
representation process 650. As indicated above, in the preferred embodiment graphical representations 61 6 are stored 
with an image-concept 604 and may be accessed directly. Any standard graphical system may be used to display the 
graphical representation 616. 

NAVIGATION IMAGE PROCESS 611 

Preferred navigation Image process 611 is Illustrated in Figure 62. In the preferred emtxxiiment, a user Is allowed 
to manipulate a sub-component of the pivotal-concept by manipulating a graphical representation 616 (manipulation 
process 652), a temporary graphical representation of the pivotal-concept which incorporates the manipulation of the 
sub-component is generated from the change in the initial graphical representation 616 (temporary representation 
process 654), a sub-list of inrtage-concepts 604 for the manipulated sub-component 607 is accessed (concept retrieval 
process 656), a list of rankings of members of the sub-list of Image-concepts based on similarity between the temporary 
graphical representation and the graphical representation of each member of the sub-list is generated (prioritization 
process 656), and an image-concept with the highest ranking in the list of rankings is selected, made into a new pivotal 
image-concept and displayed (select new image process 660). 

The first step of the preferred embodiment is manipulation process 652 during which a user is given the optkxY to 
manipulate a sub-component 607 of the pivotal image-concept 572 on display. As mentioned above, the preferred 
system is Implemented so that a pivotal Image-concept 572 has knowledge of its sub-components 607 and, for each 
sub-component 607, there is information about components of a graphical representation 616 which may vary (com- 
ponents-to-vary 592) and methods to alk>w manipulatkxi (method-to-alter 594). With this information available, a user 
may be given the option to vary a sub-component 607 using a mouse, keyboard or touch screen. If desired, components 
whbh may vary may be highlighted to make it mora apparent to a user what manipulations are available. 

Folbwing manipulation process 652 In the preferred embodiment, a temporary graphical representation 616 \s 
constructed using temporary representation process 654. Typically, the algorithm whrch guides this part of the preferred 
process is included in informatksn stored in method-to-alter 594. The output of the preferred embodiment is a graphical 
representation 616 which incorporates the manipulated change and whteh Is displayed, and an indicatbn of the sub- 
component 607 which was manipulated and the degree of change. For example, there may be an Indicatkxi that "height* 
was varied by Increasing the length of 'leg 1 * of a chair to a length of 2 mm. If desired, the algorithm stored in method- 
to-alter 594 may include in the temporary graphical representation 616, changes both to 'leg 1* and to other components 
whfch nnay be altered as a result, such as 'legs 2, 3, and 4'. 

In the prefen-ed system, the next step is concept retrieval process 656. During the process, the manipulatkxi which 
was made is categorized using definitions 600 for the sub-component 607 whbh was altered to determine the value 
590 for the sub-component 607 in the temporary graphical representation 616. For example, it will be determined 
whether the "height' based on the new 'leg length' is 'normal', 'short', or lall*. Preferably, once a new value 590 has 
been selected, the image-concepts 604 whbh have the same value 590 on the sub-component 616 are retrieved. As 
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mentioned above, in the preferred system they will have been stored with the value 590 data structure either prior to 
run time or dunng Image organization process 605. 

The image-concepts 604 which are collected in concept retrieval process 656 are prioritized during preferred pri- 
oritization process 658 based on similarity between the temporary graphical representation 616 and the graphical 
5 representation 61 6 for each image-concept 604 which was collected in concept retrieval process 656. Preferably, there 
is information 184 available for all graphical representations 616 (including the temporary graphical representation 
616) indicating the sub-components 607 included and values 590 for each sub-component 607. In the preferred em- 
bodiment, the prioritization process is similar to that described in the Nearest Neighbor system; that is. definitions of 
similarity based on attributes 1017 (sub-components 607) and attribute values 1018 (values 590) are stored and used 
10 to priorrtize the list of image-concepts 604. 

In the final step of the preferred embodiment, a new image-concept 604 is selected during select new Image 
process 660 by accessing the image-concept 604 with the highest priority ranking, maldng It the new pivotal image- 
concept 572 and displaying it using image presentation process 609. 

IS GENERAL DESCRIPTION AND DATA STRUCTURES FOR UVING EQUATIONS 

The preferred Living Equations system albws a user to examine both numerical and graphical representations of 
an equation, to manipulate the equation by altering the form of the equation, the values, or the units, and to examine 
relationships between portions of the equation and between concepts 1016 which are available in other systems such 

20 as the preferred SNETS system. A typical user display 1 01 2 for the Living Equations system is illustrated in Figure 63. 
As can be seen in the Figure, a user has access to a graphical display 832, a numerical display 826, a display of terms 
824. and a display of units 828. 

The general Living Equations system data structures 833 used to support the current embodiment of the Living 
Equations system are illustrated in Figure 64. In the preferred embodiment, an equations structure 834 holds pointers 

2S to particular equations which are available such as Poiseuilles law 444. There preferably are also sets of terms 436, 
some of which are constant terms 438 such as "pi", others of which are variable terms 440 such as flow 442. Typically* 
particular equations 834 and terms 436 have their own data stnictures in the current embodiment 

A typical equation data structure 445 is illustrated in Figure 65. In the preferred embodiment, an equation 834 has 
a name slot 446, a terms slot 462 which holds all terms 436, a typical values slot 464 which holds typical values for 

30 each term 436, and a temrts-ln-lhs slot 460 which holds the temn 436 currently on the left hand side of the equation 
834. In the current embodiment, there is also a poss-arrangements-pairs slot 454 which holds printable 456 and com- 
putable 458 forms for different layouts for the equation 834; for example, there would be a different layout If term "flow" 
were on the left hand side than if the term V were on the left hand side. The purpose of this representation in the 
preferred embodiment is to allow manipulation of the form of the equation 834 without having to perform symbolic 

^ manipulation. If symbolic manipulation were desired, slot 454 could be eliminated. In the preferred embodiment, a curr- 
arrangement-pair slot 448 stores the current printable 450 and computable 452 forms of the equation 834. 

A typical temn data structure 437 is illustrated in Figure 66. In the preferred embodiment, there typically is a name 
slot 466. a curr-val slot 468 to hold the current value of the term 436, a descriptive text slot 470 which holds a textual 
description of the term 436. a max val slot 476 and min val slot 480 to hold typical maximum and minimum values, a 

^ possible units slot 482 to hold all units which might be applicable, and a related concepts 484 slot which holds infor- 
mation about concepts 1016 which are related to the term 436. In the preferred embodiment, there are two sets of 
units, internal units (slot 472) which are used for all computations (a cun'ent value is stored in slot internal value 474). 
and physical units (slot 478) which are used for presentation to a user. The purpose for these two representations is 
to allow a user to see how an equation 834 looks with different units while enforcing consistency in internal computatnn. 

45 

LIVING EQUATIONS PROCESS DESCRIPTION 

The preferred Living Equations system follows some of the same general processes described above for the ION 
system and illustrated in Figure 2 (concept constraint process 1 68, concept display process 1 74 and navigation process 
so 176). However, in the preferred Living Equations system, these processes are specialized for organizing and displaying 
equations. In the preferred embodiment, an equation is selected and concepts related to the equation are organized 
into a manipulable, graphk:at representation of the equation during equation constraint process 491 . an equatkMf) 834 
is displayed to a user during equation display process 493 and may be altered during equation navigation process 495 
(see Figure 67). 

55 

EQUATION CONSTRAINT PROCESS 491 

The purpose of preferred equation constraint process 491 is to select an equation 510 (Figure 69) to be presented 
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to a user and to organize concepts related to the equation into a manipulabte, graphical representaticxi ot the equation. 
The components of preferred equation constraint process 491 are illustrated in Figure 68; these include available 
equations process 486 which Is used to generate a list of available equations in which the list contains equations which 
are available to the system, equation-concept relationship process 487 which is used to determine relatbnships be- 

5 tween equations and concepts, and equation selection process 489 which is used for selecting the equation to be 
displayed. Equation-concept relationship process 487 is broken down further into relationship detenninatbn process 
488 and relationship type process 490 (see Figure 69). Equation selection process 489 is further broken down into 
current concept process 492, equation constraint process 494, user equation selection process 498 and system equa- 
tion selection process 500. These processes are Illustrated in Figure 69 and will be described further below. 

10 The purpose of preferred equation constraint process 491 is to generate a list of available equatiois 834 (available 
equations process 486), determine whether a relationship exists between an equatbn 834 and concepts 101 6 in any 
available systems such as the SNETS system or the Focus system (relationship determination process 488), determine 
a relatbnship type for any equatlcm-concept relationships uncovered (relationship type process 490). generate a list 
of current concepts 1016 available in the current context (current concept process 492), generate a list of related 

IS equations 496 which are related to currently available concepts (equation constraint process 494) and ask either a 
user (user equatbn selection process 498) or the Living Equatbns system (system equation selectbn process 500) 
to select an equation 510 from the list of related equations 496. where the system would use a particular context to 
make a selection. 

A preferred first step Is to use available equations process 466 to generate a list of available equations 512 (equa- 
20 tions which are available to the system), which may be accomplished by collecting the children in the equatbns 834 
hierarchy displayed in Figure 64 (in the figure, Poiseuille's law 444 and vascular resistance 445 are examples of children 
collected by available equations process 486). The next preferred step is to determine equatbn-concept relationships 
for the list of available equations 512. As indicated above, preferably there are data structures for equations 834 whbh 
Include Information such as terms 436 In an equation 834, and preferably there are data structures for temis 436 
25 indicating related concepts 484 for a temi 436 (see Figures 65 and 66). 

One way of determining equation-concept relationships in the preferred embodiment is by following links from an 
equation 834 to its terms 436 and the terms' related concepts. Although not shown In the figures, one could also store 
relationships between an equation 834 and a set of concepts 1016 in the equation's data structure. It also would be 
possible to indicate the nature of the concept-equatbn relatbnship. For example, one couki Indbate that Poiseuille's 
30 law related to several concepts 1016 in the SNETS system and to several additional concepts in the Focus system. 
This type of information could be retrieved using relationship type process 490 and could be used to determine the 
nature of a possible interaction between an equatbn 834 and concepts 1016 in several other systems. For now; we 
will assume that all relationships are of the Living Equatbns-SNETS variety, that is, all related concepts 1016 come 
from an SNETS system. 

3S In the preferred embodiment, the next step in equation constraint and selectbn is detemiining cun'ent concepts 
of interest 514 using current concept process 492. The purpose of this step is to generate a list of concepts 1016 which 
are available in a current context. For example, the Living Equations system might be called from the Space Expbrer 
system. In the preferred Space Explorer system, there is a data structure holding a list of all dimensioned-concepts 
whbh are currently active. In another example, the Living Equations system might be called from the preferred Focus 

40 system. Again , there is a data structure holding current perspective-concepts. In either case, the preferred Living Equa- 
tions system can access the appropriate list and use it to generate the list of current concepts of interest 514. Equation 
constraint process 494 can then be used to determine whbh concepts 1016 in the list of current concepts of interest 
51 4 match concepts related to equations 834 in the list of available equations 51 2. In the preferred embodiment, when 
a match is found, the appropriate equation 834 is added to the list of related equations 496. 

4S Typically, there is more than one equation In the list of related equations 496, and a process is used to select one 
for display. One option is to albw a user to select an equatbn of Interest directly from a menu of possible equations. 
In the preferred embodiment, this process is followed in user equatbn selection process 498. Another option in the 
preferred embodiment is to albw the preferred Living Equations system to make a selectbn using system equation 
selectbn process 500. The first step in this preferred process Is selecting a concept 1016 from the list of current 

so concepts of Interest 514 to serve as an attention concept 516 using attentbn concept selection process 502 which 
selects the concept which has been manipulated most recently by the system or the user. As in current concept process 
492. this process typically would be followed when the Living Equations system is called from another system such as 
the Space Explorer system. 

Depending on whbh system makes the call, a different process may be used to select a concept 1016. For example, 
ss if the call Is made from the Space Expbrer system, the current center concept might be selected to be an attentbn 
concept 516. If the call is made from the Nearest Neighbor system, the cun'ent top concept might be selected to be an 
attention concept 516. A series of if-then statements can also be built into process 502 to handle systems whbh couki 
be making a Living Equations system call in a particular system configuration. 



35 



EP0436 663B1 

With an attention concept 516 selected, the prefen'ed embodiment uses the attention concept 516 to constrain the 
list of related equations 496 using equation list constraint process 504. In this preferred process, equations in the list 
of related equations 496 which have no relationship to attention concept 516 are removed from the list of related 
equations 496. As mentioned above, relationships between concepts 1016 and equations 834 are stored in the pre- 
5 ferred Living Equations system data structures and can be accessed for this purpose. 

The next step in the preferred embodiment is prioritizing the equations left in the list of related equations 496 using 
a prioritized equation list process 506. With this preferred process, a prtoritized equation list Is generated by rating 
equations in the constrained equation list using their relationship to the attention concept. One way to accomplish this 
step is to store in related concepts slot 484 (Figure 66) an indication of the closeness of the relatbnship between a 
10 concept 1016 and an equation which could be accessed during process 506. It also would be possible to consider all 
relationships equal and simply select an equation in a random fashion from among the list of related equations 496. if 
a prioritization is carried out. the final preferred step is selecting an equatbn 510 by determining which equation 510 
has the maximum pnority rating using final equation selection process 508. 

IS EQUATION DISPLAY PROCESS 493 

A typical user display 1012 for the Living Equations system is in Figure 63. and an illustration of the prefened 
process is in Figure 70. In the preferred embodiment, terms of an equation 834 are displayed as shown In portion 824 
of Figure 63 using term display process 518. and relationships among the terms are displayed using term relationship 

20 display process 520. As mentioned above, in the current embodiment terms 436 are stored with an equation 834 and 
can be accessed for display purposes using term display process 518. The arrangement of terms 436 can be accessed 
from poss-arrangemenl-pairs slot 454 (Figure 65) which preferably holds informatbn 1 84 about positioning of different 
tenms 436 for different display forms using term relationship display process 520. 

In the preferred embodiment, information about arrangement of terms 436 is sufficient to display the temis. Typl- 

2S cally. values for terms 436 are also displayed using value display process 522. In some cases, it may be desirable to 
display typical values. In the preferred embodiment, typical value process 524 can be used to access typical values 
slot 464 for the equation 834 to generate a list of typical values. Another option Is to select values which relate to the 
system which called the Living Equations system using related value process 526. Using this option, the attention 
concept 516 may be examined to determine whether there are values which correspond to attention concept 516. For 

30 example, a "hypertension' concept may have attached to It a value for "pressure" which Indicates that, In conditions 
of hypertension, pressure Is generally above x mm/Hg. In this case, the value may be used by the Living Equations 
system. In the preferred embodiment, it Is up to value selection process 528 to determine whether there are related 
values which are stored in an equation data structure (see Figure 65) and, if not. to use typical values 464 for the initial 
display. 

3S As illustrated in portion 828 of Figure 63, units are displayed to a user. In the preferred embodiment, unit display 
process 530 checks physical units slot 478 for each term 436 and uses this information to display units which are 
currently of interest to a user. 

A user preferably can ask for a definition of a term 436; if such a request Is made, definition display process 532 
accesses descriptive text slot 470 for the term 436 and displays the text corresponding to definition of the terms. 

40 Preferred equation display nrxxie process 535 may be used to display an equatkHi 834. Term values generated by 
value display process 522 in the preferred embodiment may be displayed both numerically using numeric display 
process 534 and graphically using graphical display process 536. In both cases, the preferred system is implemented 
so that values are available from value display process 522 and display form is available from the poss-arrangement- 
pairs slot 454 of the equation 834. Most standard graphical display packages can be used to display. the values as 

45 seen in portk)ns 826 and 832 of Figure 63. 

EQUATION NAVIGATION PROCESS 495 

In the preferred embodiment, the purpose of equation navigation process 495 is to allow a user to manipulate an 
so equation 834 by altering its term values, units or fonn. Equation navigation process 495 is Illustrated in Figure 71. 
Preferred value alteration process 540 albws a user to select a new temi value by nr^ipuiating a term value in eilher 
graphical or numeric fomn. Using value alteratkxi process 540 in the preferred embodiment, a user is given the option 
to alter a value by either selecting a term 436 in portion 826 of a display or selecting a term 436 in section 832 of a 
display (see Figure 63). In the preferred embodiment, if portk>n 832 is selected, a user may move the bar graph of a 
ss term 436 up or down as desired by using a mouse or the keyboard, and If portion 826 is selected, a user is asked to 
input a new number via a keyboard. In either case in the preferred embodiment, if a value Is selected whk:h Is above 
max val or below min val (see Figure 66), a warning is issued. Following selection of a new term value, the Uvng 
Equations preferred system adjusts remaining term values using value direct configuration process 546 and an appfo> 
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priate cx)nnputable form from Figure 65. 

A second way of navigating in the current system ts by aftertng units, if a user expresses a desire to use a new 
unit, preferred unit alteration process 542 accesses possible units 482 from Figure 66. presents them to a user and 
asks for a selectbn. The next preferred step is value unit alteration process 546 in which term values are adjusted for 

s the new unit using a number conversion table. The next step in the current embodiment is unit reconfiguration process 
552 in which remaining units are adjusted to confonm with the new. unit. This step may or may not be desired in a 
particular situation. For example, in some situations, a user may wish to use mixed units. The preferred Living Equations 
system allows for this flexibility. In fact, in the current system, enforced matches are not required, and unit reconfigu- 
ration process 552 optionally nrtay be skipped. This is possible in the preferred embodiment because system compu- 

10 tations are based on a standard set of units and terms which is stored in internal units and internal values slots 472 
and 474, and conversions are made before user preferred units are displayed. 

A third preferred method of navigatbn is through manipulatkxi of equatkjn form. A user of the preferred system 
may ask to replace a term on the left side of the equation with a term from the right side of the equation 834 using form 
manipulation process 544. Process 544 typically accesses all available temis 436 and altows a user to select the term 

IS 436 which should be on the left side. The next step in the preferred embodinnent is adjustment of term values after 
form manipulation using value fonrn reconfiguratfon process 550. Typfeally, process 550 uses poss-arrangement-pairs 
slot 454 to find the form which matches the form selected by a user and uses the new form to re-configure the displays 
and re-calculate term values. In the current embodiment, unit fomn reconfiguratnn process 554 then adjusts units to 
match the new form. 

20 

GENERAL DESCRIPTION AND DATA STRUCTURES FOR SNETS 

The preferred SNETS system altows a user to create, display, edit, store, and browse through semantic nets 1180 
(see Figure 72), and to integrate semantic nets 1180 with other fornr^ of viewing Information such as those described 

2S in the Focus and Space Expbrer systems. A semantto net is a knowledge representatk)n which displays concepts and 
relationships between them in a graphical form; concepts are represented as nodes, and relationships are represented 
as links between nodes. Figure 73 illustrates components 1147 of a typical semantk: net 1180. Typical components 
include nodes 1146. link-types 1148, links 1150 and an Index 1144. An example of a preferred SNET display 1012 of 
these components is illustrated in Figure 74. The preferred SNET system includes nodes such as fire 1138 which are 

^ connected by links such as links 1140 and 1142. Typically, links such as 1140 are of a particular link-type 1148 such 
as "prerequisite-is.' An interpretation of the display shown is that fire is caused by electrical short and lightning and 
that lightning has a prerequisite of thunderstorm. In the preferred embodiment, an index 1144 helps provide an inter- 
pretation of links. 

A system developer can use the preferred SNETS system to build and modify semantk: nets 1180. A user can 

^ view the prefened SNETS system display to gain an understanding of relatbnships among concepts 1016. The pre- 
ferred SNETS system alk>ws a user to view selected portions of a semantk: net 1180 such as "causal links only*, or 
"only concepts related to thunderstorms" and to request views either by menu or by a natural language interface. In 
the preferred embodiment, the SNETS system can be called from another system such as the Focus system and can 
call other systems as well. For example, while studying the semantic net 11 80 in Figure 74, a user may choose to call 

40 the Nearest Neighbor system from node electrical short 11 52 to view electrk:al problems similar to shorts. 

A preferred node data structure 1 1 45 is illustrated in Figure 75. Preferred slot node-label 1 1 54 holds a label for a 
node name and a method to convert the label to printable form. For example, a label may be "electrical-short." and a 
method may convert the label to "electrical short." Preferred slot links-names-and-values 1 1 56 hoWs informatfon about 
links 1150 from the node to other nodes 1146; the fonm of the knowledge is "link-type node-pointed-to" such as 'pre- 

^ requisite-is electrical-cunent." Preferred slot points-to-me 1158 holds infomnation about links from other nodes 1146 
to the node such as *caused-by fire." Preferred slot synonyms 1160 hokJs synonyms for the node-label which can be 
used for searching and navigating through a semantic net 1180. The preferred node data structure may also hoU 
information about relationships between the node and system modules. For example, there may be a slot such as 
related-equation 1162 which holds infonmation about an equation (Ohm's law, for example) in the Living Equatkrc 

so system which relates to the node. These slots may be used to determine when and how to make calls from the SNETS 
system to other systems. 

In the preferred embodiment, nodes 1146 may be stored in a knowledge base (kb) 1164 to help organize the 
infonmation (see Figure 76). For example, there may be a knowledge base 1164 called "fire knowledge base" which 
contains most or all nodes 1 1 46 related to fire. In the preferred embodiment, a semantk: net 11 80 need not be contained 
ss in one knowledge base 1164; there may be links across knowledge bases 1164. 

Figure 77 illustrates another preferred SNETS system data structure, which is called control-semantk:-nets 1168 
and which holds control infonmatk>n. In the prefened embodiment, cun'ent-links 1168 holds a list of link-types which 
have been defined, current-kbs 1169 holds a list of kbs currently used in semantic nets 1180, and current-query 1170 
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holds information on the type of view currently on display, in the current embodiment, a user may view a semantic net 
1180 in several different ways. For example, a user may ask to see the portion of a semantic net 1180 which resides 
in a partbular knowledge base 1164 or a portbn of a semantic net 1180 which connects nodes x and y. Current-query 
1170 preferably indicates which type of view is current such as 'kb fire* which indicates that the current view is a kb 

s view of the knowledge base fire. 

Preferred slot format-modification 1172 holds information on the way in which a sennantic net 1180 is displayed. 
In the preferred embodiment, SNETS may be built on top of any standard graphing package such as Xerox Corpora- 
tion's software sold under the name ■Grapher*. Graphing packages typfcally have options for graphing such as 'graph 
as a forest', or 'graph in horizontal fashion.' When such options are available, preferred slot format-modification 1172 

10 holds information on optbns currently in use. 

Preferred slot word-match-restricted-to-indexing 1174 holds infomrration on indexes currently in use. In the pre- 
ferred embodiment, a system developer has the option to create indexes to nodes 1146 which may be used to speed 
searches through a semantic net 1180. and a current index may be stored in word-nrratch-restricted-to-indexing 1174. 
Preferred slot word-match-restricted-to-kbs 1176 is used to restrbt searching to nodes in a particular knowledge 

IS base 1164; it holds information on a knowledge base 1164 to which a cun'ent search should be restricted. 

SNETS PROCESS DESCRIPTION 

The preferred SNETS system follows some of the same general processes described above for the ION system 
20 and illustrated in Figure 2 (concept display process 1 74 and navigation process 1 76). However, in the preferred SNETS 
system, these processes are specialized for organizing and displaying semantic nets. The major components of the 
preferred SNETS system process are illustrated in Figure 72. In the preferred process, a semantic net 1180 can be 
created using net building process 1178, altered using net alteration process 1182 and displayed using net display 
process 1186; different views of a net 1180 may be accessed using net navigation process 1188 In order to navigate 
25 through the semantic net; calls to other systems may be made using calls to external processes process 1184, and 
other systems may call and display a semantic net 1180 using calls from external processes process 1190. 

NET BUILDING PROCESS 1178 

30 Preferred Net Bulkfing Process 1178 is illustrated In Figure 78. In the preferred process, a user may generate a 
list of net concepts to be placed in the semantk; net 1180 (concept net definition process 1192), generate a list of net 
relationships (link-types 1148) to be used in the semantic net (relatbnship net definitbn process 1194), generate a 
node for each net concept (node definition process 1196), generate link-types 1148 for relationships in the list of net 
relationships (link-type definition process 1198) and establish links 1150 between concepts (relatbnship placement 

3S process 1200). 

In the preferred embodiment, concepts may be selected for addition to the semantic net 1180 from inside other 
systems, and concept net deflnrtton process 11 92 may be used for this purpose. For example, a system developer who 
has already created a number of perspective-concepts 146 (Figure 45) for the Focus system may decide to include 
some of the perspective-concepts 146 in a semantic net 1180. Preferred concept net definition process 1192 allows 

40 the developer to select a number of perspective-concepts 146 for Inclusion in a semantic net 1180. In the preferred 
embodiment, slots whrch are necessary for the node 1146 data structure are then added to each perspective-concept 
1 46, and the perspective-concept's name 1 48 is placed In the concept's node-label sbt 1 1 54. Preferably a perspective- 
concept 146 resides in a knowledge base 1164, and the knowledge base 1164 is added to the cun-ent-kbs sbt 1169. 
A similar process may be folbwed to select link-types 1148 from other systems for inclusion in a semantic net 

^ 1180. For example, a developer may select relationships such as those illustrated in Figure 44 (cbse^o 1^ and 
medium-ctose-to 142) for inclusion as link-types 1148 in a semantic net 1180. Preferred relationship net definitbn 
process 1 1 94 makes selected relatbnships Into link-types 1 1 48 and adds them to current-links slot 1 1 68 (Figure 77). 

In the preferred embodiment, nodes 1146 and link-types 1148 may be added in a more direct fashbn using node 
definitbn proces 1196 and link-type definitbn process 1198. Some of these processes assume that a semantic net 

so display is available and update the display as nodes and links are added. The display process will be described bebw 
in the net display process section. For now. we will assume that a display exists. The steps involved in preferred rtode 
definitbn process 1 1 96 are Illustrated In Figure 79. In the pref en-ed embodiment, when a user Indicates a desire to add 
new nodes 1 1 46 to a system, node additbn process 1 202 adds an add node to the senr^ntic net by checking current- 
kbs 1169 to determine what kbs 1164 are in use, making a list of kbs 1164 and asking the user to select a kb 1164 or 

ss name a new kb 1 1 64 in which the new node/nodes 1 1 46 shoub reside. The next step of preferred node addition process 
1202 is to ask the user whether a search shoub be made to determine whether the new node 1146 already exists in 
the system. The preferred options are: restrbt search to current knowledge base, restrict search to a different knowledge 
base, restrict search to nodes in a particular index, dont restrict at ali, and doni search at all. The next preferred step 



38 



EP0 436663B1 



is entering the new node-label 1154. 

II •doni search at all" is not selected, preferred node check process 1204 next prohibits the user from adding an 
add node to the semantic net whk:h already exists in the semantic net by checking to see if the new node-label 1154 
exists in the search space indicated by the user (current kb. for example). Preferably! if the node 1146 does not exist, 

5 it Is added to the selected kb 11 64; if it does exist preferred node find process 1 206 finds and displays a portion of the 
semantic net 1180 containing the node 11 46 to be added. 

in the preferred embodiment, new link-types 1148 are added using link-type definition process 1198 by asking the 
user to input the name of the new link-type 1148 and adding it to current-links slot 1168. 

In the preferred embodiment, links 1150 are placed between nodes, thereby defining a relattonship between two 

10 concepts, using relationship placement process 1200. Preferred relationship placement process 1200 is illustrated in 
Figure 80. Preferably, when a user indk:ates a desire to place a new link 1150, prefen-ed link addition process 1214 
places an add link between two nodes in the sennantk: net by asking the user to select an originating node 1146 (this 
may be entered directly or may be selected from a semantk; net display), presenting a menu of current link-types 1148 
and asking the user to select a link-type 1148 and to select the node/nodes which should form the other end of the 

IS link. Preferred link check process 1216 prohibits the user from adding an add link between two nodes which already 
exists in the semantic net by checking to see if the selected link already exists between the selected nodes; if a link 
does not exist, it updates linkage information in ail selected node 1146 data structures and displays the new semantic 
net 1180 (see net display section). If it does exist, link find process 1218 finds and displays a portton of the semantc 
net 1160 containing the link to be added 1150. 

20 

NET ALTERATION PROCESS 1182 

Preferred net alteration process 1182 is illustrated in Figures 79 and 80. Net alteration process 1182 altows a user 
to add and delete nodes 1146. link-types 1148 and links 1150 and to update node infonmation. In the preferred embod- 
2S iment, adding a node to an existing semantic net 1180 follows the same process as that described in net building 
process 1178 with the exceptbn that node addition process 1202 may be used to help place the new node 1146 into 
the semantic net 1180 by asking the user for information on link-types 1148 whbh should be connected to the new 
node 1146 and additk>nal nodes 1146 whbh should be connected to the new node 11 46 via selected link-types 1148. 

In the preferred embodiment, a node 1146 may be deleted from a semantic net 1180 by activating node deletnn 
30 process 1 208 on a particular node 1 1 46. Preferred node removal process 1210 deletes the node 1 1 46 from the semantic 
net 1180, and node link removal process 1212 removes links 1150 which were previously connected to the deleted 
node and updates infornrtatbn in nodes 1146 whk:h prevtously were connected to the deleted node 1146. 

The procedure for adding a link 11 50 to a sennantic net 1 1 60 is the same as that described in relattonship placement 
process 1200. 

35 Deleting a link between two nodes in the semantte net may be accomplished using preferred link deletbn process 
1226 which asks the user which originating node 1146 the link should be removed from, asks the user to select a link- 
type 1148 to be removed and asks the user to select one or more destination nodes from whrch the link should be 
removed by presenting a menu of nodes 1146 currently connected to the first node via the selected link-type 1148. 
Preferred link deletion process 1226 then removes the links and updates the data structures of affected nodes 1146. 

40 In the preferred SNETS system, new link-types 11 48 may be added to the semantic net at any time using link-type 

addition process 1 220 which is essentially equivalent to link-type definition process 1 1 98. Link-types may be removed 
using preferred link-type deletion process 1 222 which presents a menu of current link-types and asks the user to select 
the link-type to be removed. Preferred link-type link removal process 1224 then renrx>ves all links of the deleted link- 
type from the sennantto net 1180 and updates affected nodes 1146. 

45 In the preferred embodiment, there are a number of alterations which may be made to a node 1146 by selecting 

the node and choosing a function from a menu of options. For example, preferred net alteration process 1182 aikjws 
a user to edit the synonyms 1160 for the node, change the node-label 1154, view a text representation of the node, 
view the node's data structure, view a more abstract representation of the semantic net 1180 surrounding the node by 
decreasing scale and removing some links so that the overall structure is more visible, view ail nodes residing in the 

so current node's knowledge base 1 1 64 and remove, add or replace all links originating from the current node. Pref eraUjii 
modifying or viewing data structures can be accomplished in a straightforward manner using the data structures de- 
scribed above, and modifying links may be accomplished using link-modifying code described above. 

NET DISPLAY PROCESS 1186 

55 

Preferred net display process 1186 (Figure 81) presents to a user a display of part or all of a senrrantic net 1180 
(as controlled by node portion display process 1234) similar to that in Figure 74, including a display of nodes 1146 
(node display process 1228). links 1150 (link display process 1232). and link-types 1148 (link-type display process 
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1230). Preferred node display process 1228 displays ncxies in the semantic net, link display process 1232 displays 
links between ncxies in the senrtantic net, link-type display process 1 230 displays a link-type for each link In the semantic 
net. and node portion display process 1234 selectrvety displays a center node and nodes and (inks which emanate 
from the center node. 

5 Preferred node display process 1228 collects informatbn on nodes 1146 whk^ should be displayed. Typbally 

node collection will be a function of the portion of the semantic net 11 60 which is of interest. Selection of a portion of 
the semantic net 1180 for display wilt be described In the section on net navigation process 1188. Once a portion has 
been selected, preferred node display process 1228 may search through node data structures 1145 to gather a list of 
nodes 1146 for presentatbn. Preferred link display process 1232 may use the same information to gather links 1150 

to for display. Preferred link-type display process 1230 checks the list of links for display, determines whk:h link-types 
1148 are involved, and places the link-types 1148 Into an Index 1144. Preferred node portbn display process 1234 
takes information about nodes 1146, links 1150 and link-types 1148 to be displayed and places them Into a format 
appropriate for the particular graphing package currently in use; it may also pass atc^g (nformatk>n about which node 
1146 shoukJ be placed in the center of the display, if such Information is available. 

IS The preferred SNETS system may be built on top of a standard graphing package such as Xerox Corporation's 
software sold under the name 'Grapher*. Such software packages often have options for display formats and these 
may be offered to the user of the SNETS system. For example, there may be options for node font, separation between 
nodes, patterns such as lattice and forest, and orientation such as horizontal and vertical. In the preferred SNETS 
system the user also is given the optbn to view infomiatlon In a table format whk^h provides a textual rather than a 

20 graphical representatbn. 

To illustrate a typical display process, Xerox Corporation's software sold under the name ■Grapher" may be used 
as an example. With this software, the "Grapher" system Is passed a list of node records which include the fields: node, 
id which is a label to be displayed, tonodeid.llst whk:h Includes links from the node and the nodes to which they attach 
along with the wkith and dashing of the displayed link, node.font which is a font used to display the node.label, boxes? 

25 whk:h is a boolean variable indicating whether a box shoukJ be included around the label, border which is the width of 
the line used to draw the box, a node. separation value which specifies the distance between displayed nodes, and 
graph format specifications such as forest or lattice. 

In the preferred embodiment, once informatbn has been passed to the underlying graphing package, the package 
is used to display the appropriate portion of the semantic net 1180. For example, the "Grapher" system determines the 

30 layout and will display the net In a window. 

NET NAVIGATION PROCESS 1188 

Preferred net navlgatbn process 1188 (see Figure 82) allows a user to browse through a semantic net 1180 by, 
3S for example, selecting different views of the semantic net 1 1 80. In the pref en'ed embodiment, a user may make display 
decisbns through menu selection (menu selection process 1 236 which allows a user to select the center node and to 
filter out nodes and link-types by making selections from a menu) or a natural language interface (natural language 
process 1238 which allows a user to select the center node and to filter out nodes and link-types by using natural 
language). Preferred menu selection process 1236 may present a menu of options or allow a user to select optkMis 
40 from a current display screen. 

Preferred natural language process 1238 allows a user to enter English-like written commands to give instructk>ns 
or ask questions about specific semantic nets 11 60; it works by kx>king at the first word of each sentence to see if It is 
a key word which it recognizes as a command. For example, a sentence beginning with "show" or "display" wouW 
indicate that some type of display is expected. The word "relationship" indk:ates a request to see connections between 
45 two nodes 1146; tell" or "what" calls for text-based informatton. In the preferred embodiment, a typical process to 
handle natural language input is the foitowlng: 



so 
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Idefine WORD-DRIVER 1263 

{* use key word analysis to detennine portion of semantic net 1180 to display given a 

5 query) 

If query begins with "what", "tell", "show", "display" or "describe" then 

If the query starts with "what if* or "what are" then substitute "show" for "what if 
or "what are" 

If there is a general ("related", "linked") or specific (eg, "caused-by") relationship 
spe cified in the query then 

If the word "and" is in the query then break the query into the 2 parts on either 

side of the ''and" 
Remove any iw)ise words (eg. "a", "an") from the query 
,5 If t he query starts with "tell" or "describe" then 

Identify the 2 most frequently dted nodes in the query 

If a general relationship was specified in the query then 

If there are any links leading away from the 2 most frequently cited nodes 
then tell the user about these links 
20 Else display the net between Ae 2 most frequently cited nodes in the query 

Else If a specific relatioitship was specified in the query then tell the user about 
any links of the specified type, which leave the 2 most frequently cited nodes in 

the query 

Els e If a relationship and "ami" were found in the query then 

given the 2 parts on either side of the "and", find the most frequently cited node 

in each part and display the portion of the net between the 2 nodes 

Else If there axe at least 2 nodes specified in the query then display the net between 
the 2 most frequently dted nodes in the query 

Else If there is at least 1 node sj>ecified in the query then display the node and the 
^ portion of the net within 3 links of it.] 

©19883M<i>mpany 



Another feature of preferred natural language process 1238 Is the ability to recognize misspellings of typed input; 
OS rf a label Is entered which cannot be found in the SNETS system. It wilt search for similar names and ask the user i 
one of them is the desired labeL In the preferred embodiment, a list of key words is stored in a central location and 
used to interpret input commands; spelling checking is accomplished by storing a list of nodes 1146 and comparing 
potential node names to the list. Several similarity algorithms couki be used for spelling checking depending upon the 
complexity desired. For example, one might simply compare the number of letters which are the same in target and 
^ list words or devise an algorithm whteh takes into account both letter and position. 

Menu and natural language input options are available In most processes described below. The remainder of the 
preferred processes allow a user to select portions of a semantic net 1160 for display. 

Preferred display-type process 1240 allows a user to select display options including viewing all portions of a 
semantic net 1180 residing in a single kb 1164 (kb graph process 1242) or multiple kbs (many kbs process 1244), 
45 viewing that portk)n of the semantic net 1180 that Is connected to a particular node 1146 (single node proces 1246), 
artd viewing that portk>n of a semantic net 1180 which connects two selected nodes 1146 (node relatbnship process 
1248). 

In order to view a single kb 1164, preferred kb graph process 1242 requests the name of the kb of interest, accesses 
the nodes 1146 and links 1150 in the kb and feeds them to net display process 1186 for presentation. In a simiar 
so fashion, preferred many kbs process 1244 asks a user to select several kbs 1164 and displays their nodes 1146 and 
links 1150. 

Preferred single node process 1 246 (Figure 83) allows a user to select a center node 11 46, one or nnore link-types 
1 148 and a depth and displays that portion of the semantic net 1180 whk;h is connected to the center node 1146 via 
the link-types 1148 to the selected depth. 
ss Preferred center node selection process 1 250 can select a center node for the semantic net display by calling user 
select center process 1 252 to allow a user to select a center node 1 1 46. As described above, this may be done throng^ 
either a menu or natural language interface. A preferred alternative method of selecting a center is through syslem 
select center process 1254 whk:h altows the system to select the center node using the current context. Preferal% 
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this method would be used when the SNETS system is called from another system. For example, a user browsing 
through tnfomiatbn on cars tn the Space Explorer system might wish to see a semantk: net 1160 on car parts. In the 
preferred embodiment, a call to the SNETS system may be nriade and the particular car being examined at the time of 
the call may be passed to the SNETS system; if the car is a valid node 1146 It may be selected to be a center. 

5 After selecting a center, preferred filtering process 1256 (which di^tays for the user a portion of the semantic net 

by filtering out nodes and link-types) may be used to select link>types desired for presentation. For example, a user 
may choose to see only the portion of a semantic net 1180 which includes causal links. Preferred link-type generatbn 
process 1258 generates a list of available link-types 1148 by accessing current-links 1 168 (Figure 77). Next, either the 
system (system link-type seiectk)n process 1 262) or user (user link-type setectbn process 1 260) may select link-types 

10 for inclusion in a display. Preferred system link-type selection process 1262 allows the system to generate a list of 
desired link-types for presentation from the list of available link-types using the current context. Preferred process 1 262 
typically uses information from a calling system in a manner similar to that in the car example described above where 
the call is made from the Space Exptorer system. For example, if a user exploring cars with the Space Explorer system 
requests informatk>n on "car parts*, system link-type selection process 1262 may search for link-types such as *ts-a* 

IS and "part-of.' 

Prefenred user link-type selection process 1260 albws the user to generate a list of desired link-types for presen- 
tatbn from the list of available link-types. Preferred process 1260 typically provides a menu of link-types 1148 and 
asks a user to select the link-types 1148 of Interest. 

Another preferred method of viewing information in semantic nets 11 80 is allowing a user to select two nodes 1146 
20 and to request that portion of the semantk: net 1160 which connects the nodes 1146. Preferred. node relatbnship 
process 1 248 handles this viewing method by asking the user to select two nodes 11 46. In the preferred embodiment, 
if both nodes 1146 reskle in the same kb 1164 and the kb 1164 is smalt, a complete search through the kb 1164 is 
made, and connections between the nodes 1146 are displayed. If the kb 1164 is large, preferred node relationship 
process 1248 uses the indexes whbh are stored in control-semantic-nets 1166 (Figure 77) to narrow the search. 

2$ 

CALLS TO EXTERNAL PFIOCESSES PRCXJESS 1184 

In the preferred embodiment, a node 1146 may contain information on processes which relate to it. For example, 
the node 1146 illustrated in Figure 75 has a related-equation slot 1162 indicating that it is related to a Living Equattons 

00 System nrxxlule on Ohm's law. When informatton on related modules is available, and a user selects a node 1146, 
preferred calls to external processes process 1184 provides the user with the option to exit the SNETS module tem- 
porarily and to explore related information via the selected presentation mode 166 (Figure 2). For example, a user may 
be browsing through a sematic net 1180 on the subject of heart disease and might select a node labelled "aorta." 
Preferred calls to external processes process 1184 might indicate that a Focus system session on visual perspectives 

3S of the aorta Is available to the user 

CALLS FROM EXTERNAL PROCESSES PROCESS 1190 

As described above, calls may be to the SNETS system from other presentation modes 166. The individual pres- 
to entation modes 166 preferably interact with the User Modeling system to determine when to make SNETS system 
calls. Preferred calls from external processes process 1190 receives Information from calling processes and uses the 
information to determine what portbn of a semantic net 1 1 80 to display. This was described above in the net navigatkxi 
process section 1188. 

4$ 

Claims 

1. A computerized information presentation system comprising a programmed computer (88), menrwry means (92) 
for storing information, and display means for displaying infomiation on a user screen (1012), characterized in that 
so the system comprises: 

means for dynamically organizing informatbn in order to present to a user (1014) prevbusly unrecognized 
relationships among portk)ns of the information and for presenting techniques for navigation through the in- 
fonmatbn; 

ss information description means (184) comprising: 

means for storing information comprising a plurality of concepts (1016), the information description means 
comprising means for storing for each concept knowledge of alk>wable attributes (1017) for the concept and 
one or more of attributes, attribute values (1018). and relationships among attributes and attribute values; 
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categorization knowledge means (166) comprising means for storing knowledge of criteria for placing the 
concepts into categories; 

context determination means (180) for determining a context (182) based on system state; 

mapping knowledge means (178) comprising means for storing knowledge of mappings between a context 

and presentation of information; and 

dynamk: categorization means (163) for dynamically placing the concepts into categories for presentation 

using the categorization criteria, the context and the knowledge of mappings and for displaying on the user 

screen selected concepts and categories, said dynamic categorization means comprising: 

presentation rrvxie selectbn means (164) for selecting a presentation mode (166) for use in display of the 

concepts; 

concept constraint means (168) for generating a presentation list (170) of concepts to be displayed to the user 
and for constraining the concepts in the presentatron list by the presentatbn mode (166) and the context; 
category organization means (172) for generating a concept organization of concepts in the presentation list 
and for constraining the concept organization by the presentation mode and a context; 
concept display means (174) for displaying a portion of the concepts in the presentation list ar\d the concept 
organization to the user and for constraining the concept display by the presentation mode and a context; and 
navigation means (176) for alk^wing the user to navigate through the concepts comprising: 
navigation selection means (177) for selecting techniques available to the user to navigate through the con- 
cepts and for constraining the technk)ues by a context and the presentation mode; and 
navigation use means (179) for using a navigation technique to navigate through the c(Hicepts by dynamically 
re-organizIng the concepts. 

The system of claim 1 wherein: 

the concept constraint means comprises dimensioned-concept constraint means (281) for generating a di- 
mensioned-presentation list (328) of dimensbned-concepts (292) to be presented in an n-dimensbnal space; 
the category organizatfon means comprises dimension organization means (283) for organizing the dimen- 
sioned-presentation list Into an n-dimenslonal space; 

the concept display means comprises dimension presentation means (285) for displaying for the user a plurality 
of concepts simultaneously Including a conceptual center concept and a plurality of satellite concepts which 
are organized by dimensions; and 

the navigation means comprises navigation-dimension means (287) for presenting the user with a technk)ue 
of navigating through the dimensk)ns. 

The system of claim 1 or 2 wherein the dynamic categorization means further comprises: 

means for organizing concepts by their degree of similarity; 

similarity generation means (395) for generating a plurality of definitions of similarity (390); and 
similarity selection means (392) for selecting a similarity definition (398); 

the similarity generation means further comprising: similarity attribute selection means (780) for generating a 
list of selected attributes (781 ) for using in a definition of similarity (390); 

similarity attributed value selection means (782) for generating a list of selected attribute values (783) for use 
in the definitton of similarity; and 

similarity weighting means (784) for generating a weighting of members of the list of selected attributes and 
the list of selected attribute values for use in the definition of similarity 

The system of claim 3 wherein: 

the concept constraint means further comprises similarity-concept constraint means (387) for generating a 
similarity-presentation list of similarity-concepts (404) to be presenting and for selecting a top concept (410); 
the category organlzatton means comprises similarity organization means (389) for organizing the similarly- 
presentation list by degree of similarity of concepts to the top concept using the weighting; 
the concept display means comprises similarity presentation means (391 ) for displaying for the user a pluralfty 
of concepts simultaneously including a top concept and a plurality of related concepts (430). (432) which are 
organized by similarity to the top concept; and 

the navigation means comprises navigation-similarity means (393) for presenting the user with a technique of 
navigating through the similarity-concepts. 
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5. The system of claim 1 wherein the dynamic categorization means (urther comprises: 

means for organizing the concepts by perspectives (100); 

perspective description means (105) for defining a perspective as a conjunction of attribute values comprising 
an attribute value for each attribute In the perspective; 

perspective organizatbn means (101) for organizing perspectives into perspective categories (102) including 
physical perspectives (104) and functbnal perspectives (110), physical perspectives comprising perspectives 
which are organized by physical relationships (111)» functional perspectives comprising perspectives which 
are organized by functional relationships (115). 

6. The system of claim 5 wherein: 

the perspective organization means comprises perspective-type organization means (103) for organizing per- 
spective categories (102) into a plurality of perspective-types (112) within each category; 
the concept constraint means comprises perspective constraint means (165) comprising: 
concept-perspective selection means (187) for generating a perspective list of perspective-concepts (202) 
which represents different perspectives of a focal concept (150); 
perspective categoiy selection means (196) for selecting a perspective category; and 
perspective-type selection means (188) for generating a list of perspective-types (106) by selecting one or 
more perspective-types (112) from the perspective category; 

the category organization means comprises perspective organization means (189) for organizing the perspec- 
tive list of perspective-concepts according to the selected perspective-types; 

the concept display means comprises perspective presentation means (216) for displaying to the user one or 
more concepts and their perspectives (100) organized by perspective-type; and 

the navigation means comprises navigation-perspective means (1 91 ) for presenting the user with a technique 
of navigating through the perspectives. 

7. The system of claim 1 wherein the dynamic categorization means further comprises: 

means for organizing the concepts by their graphical representations (616); 

graphical representation means (616) for generating graphical representations of the concepts (616); 
decomposition means (622) for decomposing a graphical representation into a number of sub-components 
(607); and 

allowable change means (626) for generating a list of allowable changes tor a sub-component (628). allowable 
changes comprising changes which the user may make to the sub-component in a particular context. 

8. The system of claim 7 wherein: 

the concept constraint means comprises Image-concept constraint means (603) for generating an image pres- 
entation list of image-concepts (640) which may be presented, and for selecting a pivotal Image-concept (572); 
the categoiy organization means comprises image organization means (605) for generating an organization 
among the image-concepts based on relationships among the image-concepts' graphical representations; 
the concept display means comprises image presentation means (609) for displaying for the user the pivolal 
image-concept and the pivotal image-concept* s graphical representation; and 

the riavigation means comprises navigation-image means (611) for presenting the user with a technique of 
navigating through the image-concepts. 

9. The system of claim 1 wherein the dynamic categorizatbn means further comprises equation constraint means 
(491) for organizing the concepts into a manipulable, graphical representation of an equation. 

10. The system of claim 1 wherein the dynamic categorization means further comprises means for organizing fie 
concepts into a semantic net (1160). 

11 . A process of using a programmed computer (88) including memory means (92) for storing information, the process 
comprising displaying information on a user screen (1012), characterized in that the process further comprises: 

dynamically organizing infomriation in order to present to a user (1014) previously unrecognized relationshiis 
among portbrts of the infomnation and for presenting technk^ues for navigaticm through the infomtatkm; 
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storing information comprising a plurality of concepts (1016), and storing for each concept knowledge of al- 
lowable attributes (1017) for the concept and one or more of attributes, attnl)ute values (1018), and relation- 
ships among attributes and attribute values; 
storing knowledge of criteria for placing the concepts into categories; 
detemnining a context (182) based on system state; 

storing knowledge of mappings between a context and presentation of information; and 

dynamically placing the concepts into categories for presentation using the categorization criteria, the context 

and the knowledge of mappings and for displaying on the user screen selected concepts and categories, sakJ 

step of dynamically placing the concepts into categories comprising: 

selecting a presentation vnodB (166) for use in display of the concepts; 

generating a presentation list (170) of concepts to be displayed to the user and constraining the concepts in 
the presentatksn list by the presentation mode (166) and the context; 

generating a concept organizatbn of concepts in the presentation list and constraining the concept organiza- 
tion by the presentation mode and a context; 

displaying a portion of the concepts In the presentation list and the concept organization to the user and 
constraining the concept display by the presentation mode and a context; and 
albwing the user to navigate through the concepts by the steps of: 

selecting techniques available to the user to navigate through the concepts and constraining the technk)ues 
by a context and the presentatk)n nrKXie; and 

using a navigation technique to navigate through the concepts by dynamically re-organizing the concepts. 

12. The process of claim 11 wherein: 

the step of generating a presentation list comprises generating a dimensbned-presentatbn list (328) of di- 
mensioned-concepts (292) to be presented In an n-dimensionat space; 

the step of generating a concept organizatbn comprises organizing the dimenstoned-presentatbn list into an 
n-dimensional space; 

the step of displaying a portion of the concepts comprises displaying for the user a plurality of concepts simul- 
taneously including a conceptual center concept and a plurality of satellite concepts whbh are organized by 
dimensions; and 

the step of albwing the user to navigate comprises presenting the user with a technique of navigating through 
the dimensions. 

13. The process of claim 11 wherein the step of dynamically placing the concepts into categories further comprises: 

organizing concepts by their degree of similarity; 
generating a plurality of definitions of similarity (390); and 
selecting a similarity definition (398) by the steps of: 

generating a list of selected attributes (781) for using in a definitbn of similarity (390); 

generating a list of selected attribute values (783) for use in the definition of similarity; and 

generating a weighting of members of the list of selected attributes and the list of selected attribute values for 

use in the definition of similarity. 

14. The process of claim 13 wherein: 

the step of generating a presentatbn list further comprises generating a similarity-presentation list of similarity- 
concepts (404) to be presenting and selecting a top concept (410); 

the step of generating a concept organization comprises organizing the similarity-presentation list by degree 
of similarity of concepts to the top concept using the weighting; 

the step of displaying a portion of the concepts comprises displaying for the user a plurality of concepts simul- 
taneously including a top concept and a plurality of related concepts (430), (432) which are organized by 
similarity to the top concept; and 

the step of albwing the user to navigate comprises presenting the user with a technk|ue of navigating through 
the similarity-concepts. 

15. The process of claim 11 wherein the step of dynamically placing the concepts into categories further comprises: 

organizing the concepts by perspectives (100); 
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defining a perspective as a conjunction of attribute values comprising an attribute value for each attribute in 
the perspective; 

organizing perspectives into perspective categories (102) including physical perspectives (104) and functional 
perspectives (110), physical perspectives comprising perspectives which are organized by physical relation- 
ships (111), functional perspectives comprising perspectives which are organized by functional relatlonsh^s 
(115). 

16. The process of claim 15 wherein: 

the step of organizing perspectives into perspective categories comprises organizing perspective categor»s 
(102) Into a plurality of perspective-types (112) within each category; 
the step of generating a presentation list comprises the steps of: 

generating a perspective list of perspective concepts (202) which represents different perspectives of a focal 
concept (150); 

selecting a perspective category; and 

generating a list of perspective-types (106) by selecting one or more perspective-types (112) from the per- 
spective category; 

the step of generating a concept organization comprises organizing the perspective list of perspective-con- 
cepts according to the selected perspective-types; 

the step of displaying a portion of the concepts comprises displaying to the user one or more concepts and 
their perspectives (100) organized by perspective-type; and 

the step of allowing the user to navigate comprises presenting the user with a technique of navigating through 
the perspectives. 

17. The process of claim 11 wherein the step of dynamically placing the concepts Into categories further comprises: 

organizing the concepts by their graphical representations (616); 
generating graphical representations of the concepts (616); 

decomposing a graphical representation into a number of sub-components (607); and 

generating a list of allowable changes for a sub-component (628), allowable changes comprising changes 

which the user may make to the sub-component in a particular context. 

18. The process of claim 17 wherein: 

the step of generating a presentation list comprises generating an Image presentation list of image-concepts 
(640) which may be presented, and for selecting a pivotal image-concept (572); 

the step of operating a concept organization comprises generating an organization among the image-concepts 
based on relatbnships among the image-concepts' graphical representations; 

the step of displaying a portion of the concepts comprises displaying for the user the pivotal image-concept 
and tiie pivotal image-concept's graphical representation; and 

the step of allowing the user to navigate comprises presenting the user with a technique of navigating through 
the image-concepts. 

19. The process of claim 11 wherein the step of dynamically placing the concepts into categories further comprises 
equation constraint means (491) for organizing the concepts Into a nrtanlpulabte, graphical representation df an 
equatim. 

20. The process of claim 11 wherein the step of dynamically placing the concepts into categories further comprises 
organizing the concepts into a semantic net (1180). 



PatentansprQche 

1. Rechnergestutztes Informationsdarstellungssystem mit einem programmierten Computer (88), einer Spelcherein- 
rbhtung (92) zum Speichem von Informationen und mit einer Anzeigeeinrichtung zur Informationsanzeige auf 
einem Benutzerschirm (1012). dadurch gekennzeichnet. daB das System folgendes umfaBt: 

eine Einrichtung zur dynamischen Informatkjnsorganisation, so daB einem Anwender (1014) vorher nicht er* 
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kannte Beziehungen zwischen Infomnationsteilen dargestelit werden sowie zur Oarstellung von Techniken zur 
Navigation durch die Intormationen; 

eine Informattonsbeschreibungseinnchtung (1B4), die folgendes umfaBt: 

eine Einrichtung zum Speichem von Informationen, die eine Mehrzahl von Begriffen (1016) umfassen, wobei 
die Infornnationsbeschreibungselnrichtung EInrlchtungen zum Speichem jedes Begriffswissens zutassiger At- 
tribute (1017) fOr den Begriff und einer Oder mehrerer Attribute. Attributwerte (1018) und der Beziehungen 
zwischen den Attributen und den Attributwerten umfaBt; 

eine Kategoriesierungs-Wissenseinrtchtung (186), die eine Einrichtung zum Speichem des Wissens der Kri- 
terien zur Anordnung der Begrifie in Kategorten umfaBt; 

eine Kontextbestrmmungseinrk:htung (180) zur Bestimmung eines Kontexts (182) auf der Basis des System* 
zustands; 

eine Abbildungs-Wissensetnrichtung (1 78), die eine Einrichtung zum Speichem des Wissens der Abbildungen 
zwischen einem Kontext und einer Infomiatbnsdarstellung umfaBt; und 

eine dynamische Kategoriesterungseinrichtung (163) zur dynamischen Anordnung der Begriffe in Kategorren 
zur Darstellung unter Verwendung der Kategoriesierungskriterien, des Kontexts und des Wissens der Abbil- 
dungen, sowie zum Anzeigen ausgewahlter Begriffe und Kategorien auf dem Benutzerschirm, wobei die ge- 
nannte dynamische Kategoriesierungseinrichtung folgendes umfaBt: 

eine Darsteltungsmodus-Auswahleinrichtung (164) zur Auswahl eines Darstellungsmoduses (166), der zum 
Anzeigen der Begriffe venvendet werden soli; 

eine Begriffseinschrankungsselnrtehtung (1 68) zur Erzeugung einer Oarstellungsliste (1 70) der dem Anwender 
anzuzeigenden Begriffe sowie zur Einschrankung der Begriffe in der Oarstellungsliste durch den Darstellungs- 
nrKxJus (166) und den Kontext; 

eine Kategorie-Organlsationseinrichtung (172) zur Erzeugung einer Begriff sorganisatlon in der Oarstellungs- 
liste und zur Einschrankung der Begriffsorganisatbn durch den Oarstellungsmodus und einen Kontext; 
eine Begriffsanzeigeeinrichtung (1 74) zum Anzeigen eines Teils der Begriffe in der Oarstellungsliste sowie der 
Begrlffsorganisation fOr den Anwender sowie zur Einschrankung der Begriffsanzeige durch den Darstellungs- 
nrxxius und einen Kontext; und 

eine Navigatbnseinrichtung (176), die es dem Anwender ermoglbht, durch die Begriffe zu navigieren. wobei 
die Navigatbnseinrichtung folgendes umfaBt: 

eine Navigatlons-Auswahleinrichtung (177) zur Auswahl von Techniken, die dem Anwender zur Navigatk)n 
durch die Begriffe zur VerfOgung stehen, sowie zur Einschrankung der Techniken durch einen Kontext und 
den Oarstellungsmodus; und 

eine Navigations-Benutzereinrichtung (179) zur Ven^^endung einer Navigattonstechnik urn durch dynamische 
Reorganisation der Begriffe durch die Begriffe zu navigieren. 

System nach Anspruch 1 . wobei: 

die Begrrffseinschrankungseinrichtung eine dimensionierte Begriffseinschrankungseinrichtung (281) zur Er- 
zeugung einer dimension ierten Oarstellungsliste (328) dimensionierter Begriffe (292) umfaBt, die in einem n- 
dimensionalen Raum dargestelit werden sollen; 

die Kategorie-Organisationseinrichtung eine Oimensions-Organisationseinrichtung (283) zur Organisation der 
dimensionierten Oarstellungsliste in einem n-dimensbnalen Raum umfaBt; 

die Begriffsanzeigeeinrichtung eine OimenslonsdarsteKungseinrlchtung (285) umfaBt, die dazu dient, dem An- 
wender gleichzeitig eine Mehrzahl von Begriffen anzuzeigen, wobei diese einen konzeptionellen Hauptbegriff 
und eine Mehrzahl von Satellitenbegriffen umfassen. die durch Oimensionen organisiert sind; und wobei 
die IMavigationseinrichtung eine Navigations-Oimensionseinrichtung (287) umfaBt. die dem Anwender eine 
Technik zur Navigation durch die Oimensronen bereitstellt. 

System nach Anspruch 1 oder 2, wobei die dynamische Kategoriesierungseinrichtung femer folgendes umfaBt: 

eine Einrichtung zur Organisation der Begriffe gemaB deren Ahnlichkertsgrad; 

eine Ahnlichkeits-Erzeugungseinrichtung (395) zur Erzeugung einer Mehrzahl von Ahnllchkeitsdefinitnnen 
(390); und 

eine Ahnlichkeits-Auswahleinrichtung (392) zur Auswahl einer Ahniichkeitsdefinltion (398); 
wobei die Ahnlichkeits-Erzeugungseinrichtung femer fotgendes umfaBt: 

eine Ahnlichkeitsattribut-Auswahletnrichtung (780) zur Erzeugung einer Liste ausgewahlter Attribute (781) 
zum Einsatz bei einer Ahniichkeitsdefinltion (390); 

eine Ahnlichkeitsattributwert-Auswahleinrichtung (782) zur Erzeugung einer Liste ausgewahlter Attributwerte 
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(783) zum Etnsatz bei der Ahnlichkeitsdefinition; und 

eine Ahnlichkeits-Bewertungseinnchtung (784) zur Erzeugung e'mer Bewertung der Elemente der Lisle der 
ausgewahtten Attribute und der Lisle der ausgewahlten Attributwerte zum Einsatz bei der Ahnltchkeitsdefinl- 
tbn. 

System nach Anspruch 3. vvobei: 

die Begriffseinschrankungseinrichtung femer eine Ahnlichkeitsbegriffs-Einschrankungseinrlchtung (387) zur 
Erzeugung einer Ahniichkeits-Darsteltungsliste von Ahnlichkeitsbegriffen (404) zur Darstellung und Auswahl 
eines Oberbegriffs (410) umfa81; 

die Kategorie-Organisalionseinrichlung eine AhnlichkeitsOrganisationseinrichtung (389) zur Organisation der 
AhnlichkeitS'Oarsteilungsliste gemaB dem Ahnlichkeitsgrad der Begriffe zu dem Oberbegriff umfa3t, und zwar 
unter Verwendung der Bewertung; 

die Begriffsanzeigeetnrichtung eine Ahnlk:hkeits-Darstellungseinrichtung (391) umtaBt. die dazu dient, dem 
Anwender gleichzettig eine Mehrzahl von Begriffen anzuzeigen. wobei diese einen Oberbegriff und eine Mehr- 
zahl verwandter Begriffe (430). (432) umfassen, die durch die Ahnlichkeit zu dem Oberbegriff organisiert sind; 
und wobei 

die Navigatbnseinrichtung eine Navigations-Ahnlichkeitseinrichtung (393) umfaBt. die dem Anwender eine 
Technik zur Navigation durch die Ahnlichkeitsbegriffe bereitstettt. 

System nach Anspruch 1, wobei die dynamische Kategoriesierungseinnchtung femer folgendes umfaBt: 

eine Einrichtung zur Organisation der Begriffe durch Perspektiven (100); 

eine Perspektiven-Beschreibungseinrrchtung (1 05) zur Definitbn einer Perspektive als eine VerknQpfung von 
Altributwerten mil einem Attributwert f Or jedes Attribut in der Perspektive; 

eine PerspektivenOrganisationseinrichtung (101) zur Organisation der Perspektiven in Perspektivenkatego- 
rien (102), die physikalische Perspektiven (104) und funktionelle Perspektiven (110) aufweisen, wobei die 
physikalischen Perspektiven Perspektiven umfassen, die durch physikaiische Bsziehungen (111) organisiert 
sind, wobei die f unktioneilen Perspektiven Perspektiven umfassen. die durch funktionelle Beziehungen (115) 
organisiert sind. 

System nach Anspruch 5, wobei: 

die Perspektiven-Organisatk>nseinrk:htung eine Perspektivenart-Organisationseinrichtung (103) umfaBt, die 
dazu dient, die Perspektlvenkategorien (102) in einer Mehrzahl von Perspektivenarten (112) innerhalb jeder 
Kategorie zu organisieren; 

wobei die Begriffseinschrankungseinrichtung eine Perspektiven-Einschrankungseinrichtung umfa3t, die fol- 
gendes umfaBt: 

eine Begriffsperspektiven-Auswahleinrbhtung (1 87) zur Erzeugung einer Perspektivenliste von Perspektiven- 
begriffen (202), die unterschiedliche Perspektiven eines fokalen Begriffs (150) darstellt; 
eine Perspektivenkategorie-Auswahleinrichtung (196) zur Auswahl einer Perspektivenkategorie; und 
eine Perspektivenarl-Auswahlelnrichtung (188) zur Erzeugung einer Liste der Perspektivenarten (106) durch 
Auswahl einer Oder mehrerer Perspektivenarten (112) aus der Perspektivenkategorie; 
wobei die Kategorie-Organisatk)nseinrk:htung eine Perspektiven-Organisationseinrichtung (189) zur Organn 
satk)n der Perspektivenliste der Perspektivenbegrlffe genrtaB den ausgewahlten Perspektivenarten umfaBt; 
wobei die Begriffsanzeigeelnrichtung eine Perspektiven-Darsteliungseinrichtung (216) umfaBt, die dazu dient, 
dem Anwender einen Begriff bzw. mehrere Begriffe und deren durch die Perspektivenart organ isierte Per- 
spektiven (100) anzuzeigen; und wobei 

die Navigationseinrtehtung eine Navigations-PerspektiveneinrKhtung (191) umfaBt. die dem Anwender eine 
Technik zur Navigation durch die Perspektiven bereitstelll 

System nach Anspruch 1, wobei die dynamische Kategoriesierungseinrichtung ferner folgendes umfaBt: 

eine Einrichtung zur Organisatk>n der Begriffe durch deren graphische Darsteliungen (616); 
eine graphische Darsteliungseinrk^htung (618) zur Erzeugung graphischer Darsteliungen der Begrilfe (616); 
eine Dekompositionseinrichtung (622) zum Auflosen einer graphlschen Darstellung in eine Mehrzahl von Tei(* 
komponenten (608); und 

eine Einrichtung zulassiger Veranderungen (626) zur Eizeugung einer Liste zulassiger Veranderungen fur 
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eine Teilkomponente (628), wobei die zulassigen Veranderungen Veranderungen umfassen, die der Anwender 
an der Teilkomponente in einem bestimmlen Kontext durchfOhren kann. 

8. System nach Anspruch 7, wobet: 

die Begriffseinschrankungseinrichtung eine Bildbegrifls-Einschrankungseinrichtung (603) zur Erzeugung ei- 
ner Bilddarstel lungs! iste darstellbarer Bildbegriffe (640) umfaBt, sowie zur Auswahl eines drehbaren Bildbe- 
griffs (572); 

wobei die Kategorie-Organisationseinrichtung eine Bikl-Organisationseinrbhtung (605) zur Erzeugung einer 
Organisation der Bildbegriffe auf der Basis der Beziehungen zwischen den graph»chen Darstellungen der 
BiWbegriffe umfaftt; 

wobei die Begriffsanzeigeeinrichtung eine Bitd-Oarstellungseinrichtung (609) umfaBt, die dazu dient, dem An- 
wender den drehbaren Bildbegriff und die graphische Darstellung des drehbaren Bikibegrifls anzuzetgen; und 
wobet 

die Navigatbnsetnrwhtung eine Navigattons-Bildeinrichtung (611) umfaBt, die dem Anwender eine Technik 
zur Navigation durch die Bikfbegriffe bereitsteltt. 

9. System nach Anspruch 1 , wobei die dynamische Kategoriesierungseinrichtung femer eine Gleichungs-Einschran- 
kungseinrbhtung (491 ) zur Organisation der Begriffe in einer manipulierbaren graphischen Darstellung einer Glei- 
Chung umfaBt. 

10. System nach Anspruch 1. wobei die dynamische Kategoriesierungseinrichtung femer eine Einrichtung zur Orga- 
nisation der Begriffe in einem semantischen Netz (1180) umfaBt 

11. Verfahren der Venvendung eines programmierten Computers (88), der eine Spelchereinrichtung (92) zum Spei- 
chern von Informationen aufweist, wobei das Verfahren die Infomnatbnsanzeige auf einem Benutzerschirm (1012) 
umfaBt, dadurch gekennzeichnet, daB das Verfahren femer folgende Schritte umfaBt: 

dynamische Informationsorganlsatbn, so daB einem Anwender (1014) vorher nicht erkannte Beziehungen 
zwischen Informatbnsteilen angezeigt werden sowie zur Darstellung von Techniken zur Navlgatk>n durch die 
Informationen; 

Speichern von Informationen, die eine Mehrzahl von Begriffen (1016) umfassen, und zum Speichem jedes 
Begriffswissens zulassiger Attribute (1017) fur den Begrlff und einer oder mehrerer Attribute, Attributweite 
(1018) und der Beziehungen zwischen den Attributen und den Attributwerten; 
Speichem des Wissens der Kriterlen zur Anordnung der Begriffe in Kategorien; 
Bestimmung eines Kcmtexts (182) auf der Basis des Systemzustands; 

Speichem des Wissens der Abbildungen zwischen einem Kontext und einer Informationsdarstellung; und 
dynamische Anordnung der Begriffe in Kategorien zur Darstellung unter Venvendung der Kategoriesierungs- 
kriterien. des Kontexts und des Wissens der Abbildungen, sowie zum Anzelgen ausgewahlter Begriffe und 
Kategorien auf dem Benutzerschirm. wobei der genannte Schritt der dynamischen Anordnung der Begriffe in 
Kategorien folgendes umfaBt: 

Auswahl eines Darstellungsmoduses (166), der zum Anzeigen der Begriffe verwendet werden soil; 
Erzeugung einer Darstellungsliste (170) der dem Anwender anzuzeigenden Begriffe sowie Einschrankungder 
Begriffe in der Darstellungsliste durch den Darstellungsmodus (166) und den Kontext; 
Erzeugung einer Begriffsorganisatton In der Darstellungsliste und Einschrankung der Begriffsorganisalnn 
durch den Darstellungsmodus und einen Kontext; 

Anzeigen eines Tells der Begriffe in der Darstellungsliste sowie der Begriffsorganisatbn fOr den Anwenden 

und Einschrankung der Begriffsanzeige durch den DarstellungsnfKxius und einen Kontext; und 

den Schritt, der es dem Anwender mdglich macht, durch die folgenden Schritte durch die Begriffe zu navigie- 

ren: 

Auswahl von Techniken, die dem Anwender zur Navigation durch die Begriffe zur Vert Ogung stehen» sowie 
Einschrankung der Techniken durch einen Kontext und den Darstellungsmodus; und 
VenA/endung einer Navigationstechnik, die dazu dient, durch dynamische Reorganisation der Begriffe duRh 
die Begriffe zu navigieren. 

12. Verfahren nach Anspruch 11, wobei: 

der Schritt der Erzeugung einer Darstellungsliste die Erzeugung einer dimenskmierten Darstellungsliste (320) 
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dimensionierter Begriffe (292) umfaBt, die in einem n-dimensbnalen Raum dargestelll warden sollen; 

der Schritt der Erzeugung einer Begriffsorganisatton die Organisation der dimensionierten Darslellungsliste 

In einem nnjimensronalen Raum umlaBt; 

der Schrttt des Anzeigens eines Tetls der Begriffe den Schritt umfaBt. durch den dem Anwender gleichzeitig 
eine Mehrzahl von Begriffen angezeigt wird, wobei diese einen konzeptionellen Hauptbegriff und eine Mehr- 
zahl von Satellitenbegriffen umfassen. die durch Dimensionen organisiert sind; und wobei 
der Schritt. der dem Anwender die Navigation emidgllcht. den Schritt umfafM, der dem Anwender eine Technik 
zur Navigation durch die Dimensionen berettstetlt. 

13. Verfahren nach Anspruch 11, wobei der Schritt der dynamischen Anordnung der Begriffe in Kategorien femer 
folgende Schritte unnfaBt: 

Organisation der Begriffe gemaB deren Ahnlichkeltsgrad; 
Erzeugung einer Mehrzahl von Ahnlichkeitsdefinitionen (390); und 
Auswahl einer Ahnlichkeitsdefinrtk)n (398) durch die folgenden Schritte: 

Erzeugung einer Liste ausgewahlter Attribute (781) zum Einsatz bei einer Ahnlichkeitsdefinitbn (390); 
Erzeugung einer Liste ausgewahlter Attrlbutwerte (783) zum Einsatz bei der Ahnllchkeitsdefinition; und 
Erzeugung einer Bewertung der Elemente der Liste der ausgewahlten Attribute und der Uste derausgewahlten 
Attrlbutwerte zum Einsatz bei der Ahnlichkeitsdefinitbn. 

14. Verfahren nach Anspruch 13» wobei: 

der Schritt der Erzeugung einer Darstellungsllste ferner die Erzeugung einer Ahnlichkeits-Darstellungsliste 
von Ahniichkeitsbegriffen (404) zur Darstellung und Auswahl eines Oberbegriffs (410) umfa8t; 
der Schritt der Erzeugung einer Begrlffsorganisation femer die Organisation der Ahnlichkeits-Darstellungsliste 
gemaB dem Ahnlichkeltsgrad der Begriffe zu dem Oberbegriff umfaBt. und zwar unter Verwendung der Be- 
wertung; 

der Schritt des Anzeigens eines Tells der Begriffe den Schritt umfaBt. durch den dem Anwender gleichzeitig 
eine Mehrzahl von Begriffen angezeigt wird, wobei diese einen Oberbegriff und eine Mehrzahl verwandter 
Begriffe (430), (432) umfassen, die durch die Ahnllchkeit zu dem Oberbegriff organisiert sind; und wobei 
der Schritt, der dem Anwender die Navlgatbn ermoglicht, dem Anwender eine Technik zur Navigation durch 
die Ahnlichkeltsbegriffe bereitstellt. 

15. Verfahren nach Anspruch 11, wobei der Schritt der dynamische Anordnung der Begriffe in Kategorien femer fol- 
gende Schritte umfaBt: 

Organisation der Begriffe durch Perspektiven (100); Definition einer Perspektive als eine VerknOpfung von 
Attributwerten mit einem Attrlbutwert fOr jedes Attribut in der Perspektive; 

Organisation der Perspektiven in Perspektivenkategorien (102). die physikalische Perspektiven (104) und 
funktlonelle Perspektiven (110) aufweisen, wobei die physlkallschen Perspektiven Perspektiven umfassen, 
die durch physikalische Beziehungen (111) organisiert sind. wobei die f unktionellen Perspektiven Perspektiven 
umfassen, die durch funktbnelle Beziehungen (115) organisiert sind. 

16. Verfahren nach Anspruch 15, wobei: 

der Schritt der Organisatbn der Perspektiven in Perspektivenkategorien die Organisation der Perspektiven- 
kategorien (102) in einer Mehrzahl von Perspektivenarten (112) innerhalb jeder Kate^rie umfaBt; 
wobei der Schritt der Erzeugung einer Darstellungsllste die fotgenden Schritte umfaBt: 
Erzeugung einer Perspektivenliste von Perspektivenbegriffen (202). die unterschiedliche Perspektiven eines 
fokalen Begriffs (150) darstellt; 
Auswahl einer Perspektlvenkategorie; und 

Erzeugung einer Liste der Perspektivenarten (106) durch Auswahl einer oder mehrerer Perspektivenarten 
(112) aus der Perspektlvenkategorie; 

wobei der Schritt der Erzeugung einer Begriffsorganlsation die Organisation der Perspektivenliste der Per- 
spektivenbegriffe gemaB den ausgewahlten Perspektivenarten umfaBt; 

wobei der Schritt des Anzeigens eines Tells der Begriffe den Schritt umfaBt, bei dem dem Anwender ein Begriff 
bzw. mehrere Begriffe und deren durch die Perspektlvenartorganlsierte Perspektiven (100) angezeigt werden; 
und wc^ei 
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der Schrttt der dem Anwender die Navigatk)n ermogticht, dem Anwendar eina Technik zur Navigation durch 
die Perspektiven bereitstellt. 

17. Verfahren nach Anspruc^ 11. wobei der Schritt der dynamischen Anordnung der Begriffe in Kategorien femer 
5 fotgende Schritte umfaBt: 

Organisation der Begriffe durch deren graphische Darstellungen (616); 
Erzeugung graphischer Darstellungen der Begriffe (616); 

Aufldsen einer graphischen Darstellung in eine Mehrzahl von Teilkonrtponenten (608); und 
10 Erzeugung einer Liste zulassiger Veranderungen f Or eine Teilkomponente (628), wobei die zulassigen Veran- 

derungen Veranderungen umfassen. die der Anwender an der Tellkonrtponente in einem bestimmten Kontext 
durchfuhren kann. 

18. Verfahren nach Anspruch 17, wobei: 

15 

der Schritt zur Erzeugung einer Darstellungsliste den Schritt der Erzeugung einer Bilddarsteiiungsliste dar- 
steiibarer Bildbegriffe (640) umfa3t, sowie zur Auswahi eines drehbaren Bildbegriffs (572); 
wobei der Schritt der Durchf Qhrung einer Be griff sorganisation die Erzeugung einer Organ isatk)n .der Bikibe- 
griffe auf der Basis der Beziehungen zwischen den graphischen Darstellungen der Bildbegriffe umfaBt; 
20 wobei der Schritt des Anzeigens eines Tells der Begriffe den Schritt umfaBt, in dem dem Anwender der dreh- 

bare Bildbegriff und die graphische Darsteltung des drehbaren Bildbegriffs angezeigt werden; und wobei 
der Schritt, der dem Anwender die Navigation emnoglicht, dem Anwender eine Technik zur Navigation durch 
die Bildbegriffe bereitstellt 

25 19. Verfahren nach Anspruch 1 1 , wobei der Schritt der dynamischen Anordnung der Begriffe in Kategorien femer eine 
Gleichungs-Einschrankungseinrtchtung (491) zur Organisation der Begriffe In einer manipuiierbaren graphischen 
Darstellung einer Glerchung umfaBt. 

20. Verfahren nach Anspruch 11, wobei der Schritt der dynamischen Anordnung der Begriffe in Kategorien femer die 
^ Organisatbn der Begriffe in eInem semantischen Netz (1160) umfaBt. 



Revendieatlons 

3S 1. Syst^me de presentation d'informatlon par ordlnateur, comprenant un ordlnateur programme (88), des moyens 
de memorisation (92) pour mdmoriser Tinformation et des moyens d'affichage pour afflcher i'lnformation sur un 
ecran d'utilisateur (1012), caractdrisd en ce que le syst^me comprend : 

des moyens pour organiser dynamiquement f'inf ormatk>n af in de presenter d un utilisateur (1014) des relatkms, 
^ non reconnues precddemment, panmi des parties de I'information et pour presenter des techniques de navi- 

gation d travers t'information, 

des moyens de descriptbn d'information (164) comprenant : 

des moyens pour merrwriser I'infomriation comprenant une pluralit6 de concepts (1016), tes moyens de des- 
cription d'informatlon comprenant des moyens pour m^moriser chaque connaissance de concept de caract6- 
ristkfues admissibles (1017) pour le concept et une ou plusteurs des caractdristlques, valeurs de caract^ris- 
tque (1018) et relations entre des caracteristiques et des valeurs de caractdristique, 
des moyens de connaissance de categorisation (186) comprenant des moyens pour memoriser une connais- 
sance de entires afin de placer les concepts dans des categories, 

des moyens de determination de contexte (180) afin de determiner un contexte (182) sur base d'un etatde 
so systeme. 

des moyens de connaissance de correspondance (178) comprenant des moyens pour memoriser une con- 
naissance de correspondances entre un contexte et une presentatbn d'informatbn, et 
des moyens de categorisation dynamiques (163) pour placer dynamiquement les concepts dans des catego- 
ries en vue d'une presentation en utiiisant les criteres de categorisation, le contexte et la connaissance de 
ss correspondances, et en vue d'un affichage sur i'ecran de i'utilisateur de concepts et categories seiectlonn6s, 

tes moyens de categorisation dynamiques comprenant : 

des moyens de selection de mode de presentation (164) afin de seiectionner un mode de presentation (166) 
^ utiiiser dans I'aff ichage des concepts. 
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des moyens da limitation de concepts (166) pour produire una llste da presentation (170) da concepts, k 
affichar pour f'utilisateur, et pour linniter las concepts dans la liste da presentation par la mode cteprespntation 



das moyens d'organisation de cat^gorte (172) pour produire une organisation da concepts dans la liste de 
presentation et pour limrter ['organisation da concepts par le mode da presentation et par un contexte, 
das moyens d'affichage de concept (174) afin d'afficher une partle das concepts dans (a liste de presentation 
et ('organisation de concept pour I'utilisateur et afin de timiter I'affichage de concepts par (e mode de presen- 
tation et par un contexte, et 

des moyens de navigatbn (176) pour permettre k I'utilisateur de naviguer ^travers les concepts, comprenant : 
des moyens da selection da navigation (177) pour choisir das techniques disponibles pour i'utilisateur afin de 
naviguer k travers les concepts et pour llmiter les techniques par un contexte et par un mode de presentation, et 
des moyens d'utilisation de la navigation (179) pour utiliser une technique de navigatbn afin de naviguer k 
travers les concepts en reorganlsant dynamlquement les concepts. 

Systeme suivant la revendication 1, caracterise en ce que : 

les moyens de limitaticxi de concepts comprennent des moyens de limitation de concepts dimensionnes (261 ) 
pour produire une liste de presentation dimensicHinee (328) de concepts dimensionnes (292) k presenter dans 
un espace k n dimensions, 

les moyens d'organisation de categorie comprennent des moyens d'organisation de dimensions (283) pour 
organiser dans un espace k n dimensions la liste de presentation dimenslonnee, 

les moyens d'affichage da concepts comprennent des moyens de presentation de dimensions (285) pour 
afficher pour I'utilisateur une pluralrte de concepts comprenant simultanement un concept de centre conceptuel 
et une pluralite de concepts satellites qui sont organises par dimensions, et 

les moyens de navigation comprennent des moyens de dimensions de navigation (287) pour presenter k 
I'utilisateur une technique de navigation k travers les dimensions. 

Systeme suivant la revendication 1 ou 2, caracterise en ce que tes moyens de categorisation dynamiques com- 
prennent en outre : 

des moyens pour organiser des concepts par leur degre de similitude, 

des nrx>yens de production de similitude (395) pour produire une pluralite de definitions de similitude (390), et 
des moyens de selection de similitude (392) pour seiectionner une definition de similitude (398). 
las moyens de production de similitude comprenant en outre : 

des moyens de selection da caracteristiques da similitude (760) pour produire une liste de caracterlstiques 
seiectionnees (781) § utiliser dans une definition de similitude (390), 

des moyens de selection de valours de caracteristique de similitude (762) pour produire une liste de valeurs 
da caracteristiques seiectionnees (783) k utiliser dans la definition de similitude, et 

des moyens de ponderation de similitude (784) pour produire une ponderation d'eiements de la liste de ca- 
racteristiques seiectionnees et de la llste de valeurs de caracteristiques seiectionnees, k utiliser dans la de- 
finition de similitude. 

Systems suivant la revendication 3, caracterise en ce que : 

les moyens de limitation de concepts comprennent en outre des nfK>yens de limitation de concepts de similitude 
(387) pour produire une liste de presentation de similitude de concepts de similitude (404) k presenter et pour 
seiectionner un concept superieur (410), 

les moyens d'organisation de categorie comprennent des moyens d'organisation de similitude (389) pour or- 
ganiser la liste de presentation de similitude par degre de similitude de concepts, jusqu'au concept superieur, 
en utillsant la ponderation, 

les moyens d'affichage de concept comprennent des moyens de presentation de similitude (391 ) afin d'afftcher 
pour I'utilisateur une pluralite de concepts comprenant simultanement un concept superieur et une pluralite 
de concepts (430), (432) qui s'y rapportent et qui sont organises par similitude jusqu'au concept superieur, et 
les moyens de navigation comprennent des moyens de similitude de navigation (393) pour presenter k Futiii- 
sateur une technique de navigation k travers les concepts de similitude. 

Systems suivant la revendication 1 , caracterise en ce que les moyens de categorisation dynamiques comprennent 
en outre : 



(166) et par le contexte, 
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des moyens pour organiser (es concepts par des perspectives (100), 

des moyens de description de perspective (105) pour d^ternniner une perspective en tant que conjonction de 
valours de caractdristrques comprenant une valeur de caract^ristique pour chaque caractdristtque de ta pers- 
pective, 

des moyens tforganisation de perspectives (1 01 ) pour organiser des perspectives en des categories de pers- 
pectives (102) comprenant des perspectives physiques (104) et des perspectives fonctbnnelles (110), des 
perspectives physiques comprenant des perspectives qui sont organis^es par des relations physiques (111), 
des perspectives fonctionnelles comprenant des perspectives qui sont organis^es par des relations fonction- 
ne!!es(115). 

Syst6me sulvant la revendication 5, caractdrisd en ce que : 

[es moyens d'organisation de perspectives comprennent des nrK)yens d'organisatlon de types de perspectives 
(103) pour organiser des categories de perspectives (102) en une plurality de types de perspectives (112) 
dans chaque categorie. 

les moyens de limitation de concepts comprennent des moyens de limitation de perspectives (165) 
comprenant : 

des moyens de selection de perspectives de concepts (167) pour produire une liste de perspectives de con- 
cepts de perspectives (202) qui reprdsente ditrerentes perspectives d'un concept focal (150), 
des moyens de selection de categories de perspectives (1 96) pour seiectionner une catdgorie de perspectives, 
et 

des moyens de selection de types de perspectives (186) pour produire une liste de types de perspectives 
(106) en setectionnant un ou plusieurs types de perspectives (112) k partir de la categorie de perspective, 
les moyens ^organisation de categories comprennent des moyens d'organisatlon de perspectives (169) pour 
organiser la liste de perspectives de concepts de perspectives sulvant les types de perspectives seiecttonnes, 
les moyens d'affichage de concepts comprennent des moyens de presentation de perspectives (216) pour 
afficher pour I'utilisateur un ou plusieurs concepts et leurs perspectives (100) organises par type de perspec- 
tive, et 

les nrK>yens de navigation comprennent des moyens de perspectives de navigation (1 91) pour presenter d 
I'utilisateur une technique de navigation k travers les perspectives. 

Systeme suivant la revendication 1 , caracterise en ce que les moyens de categorisation dynamiques comprennent 
en outre : 

des moyens pour organiser les concepts par leurs representations graphiques (616), 

des moyens de representation graphique (618) pour produire des representations graphiques des concepts 

(616). 

des moyens de decomposition (622) pour decomposer une representation graphique en un nombre de sous- 
composants (607). et 

des moyens de changements admissibtes (626) pour produire une liste de changements admissibles pour un 
sous-composant (628), des changements admissibles comprenant des changements que i'utilisateur peut 
realiser dans Is sous-composant dans un contexte particulier. 

Systeme suivant la revendication 7. caracterise en ce que les moyens de limitation de concepts comprennent des 
moyens de limitaticm de concepts d*innages (603) pour produire une liste de presentation d'images de concepts 
d'images (640) qui peuvent dtre presentee et pour seiectionner un concept d'images pivotantes (572), 

les moyens d'organisatlon de categories comprennent des moyens d'organisatlon d'tnnages (605) pour pn>- 
dulre une organisation parmi les concepts d'images. sur base de relations parmi les representations graphi- 
ques de concepts d'images, 

les moyens d'affichage de concepts comprennent des nrK>yens de presentation d'images (609) afin d'afficher 
pour rutilisateur le concept d'images pivotantes et les representations graphiques des concepts d'images 
pivotantes, et 

les moyens de navigation comprennent des nr^yens d'images de navigation (611) pour presenter k rutilisateur 
une technique de navigation k travers (es concepts d'images. 

Systems suivant la revendicatbn 1 , caracterise en ce que tes nrtoyens de categorisatbn dynamiques comprennent 
en outre des moyens de limitation d'equation (491 ) afin d'organiser les concepts en une representation graphique 
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manipulable d'une Equation. 

10. Systdme suivant [a revendicatbn 1 , caract6rls6 en ce que les moyens de cat6gortsation dynamiquescomprennent 
en outre des moyens pour organiser les concepts en un r6seau s^mantique (1160). 

11. Processus d'utilisation d'un ordinateur programm§ (86) comprenant des moyens de m^orisation (92) pour m§- 
moriser una information, le processus comprenant un affichage d'informations sur un teran d'utilisateur (1012). 
caractdrisd en ce que le processus comprend en outre : 

une organisation dynamique d'tnfonmations aftn da presenter k un utilisateur (1014) des relations, non recon- 
nues pr6c6demment, parmi des parties de finformatbn, et pour presenter des teclinlques pour une rtavigation 
k travers {'information, 

une m§morisatbn d'informations comprenant une p!ufBlit6 da concepts (1016), et une m^nrrarlsation pour 
cliaque connaissance de concept de caract^ristiques admisstbles (1017) pour le concept et pour une ou plu- 
sieurs des caractdristiques. valeurs de caractdrlstkiues (1018) et relations entre des caractdristiques et des 
valeurs de caractdristiques, 

une memorisation d'une connaissance de entires pour placer les concepts en categories, 
une determination d'un contexte (182) sur base d'un 6tat du systfeme, 

une memorisation d*une connaissance de correspondances entre un contexte et une presentation dlnforma- 
tion, et 

un agencenrtent dynamique des concepts en categories pour une presentation en utilisant les crit&res de ca- 
tegorisation, le contexte et la connaissance de correspondances, et pour un affichage sur recran d'utllisateur 
de concepts et categories seiectionnes, retape d'agencer dynamiquement les concepts dans des categories 
comprenant : 

une selection dun mode de presentation (166) k utiliser dans un affichage des concepts, 

une production d'une liste de presentation (170) de concepts k afficher pour i'utilisateur et une limitation des 

concepts dans la liste de presentatbns par le mode de presentation (166) et par le contexte, 

une productbn d'une organisation de concepts dans la tiste de presentation et une limitation de {'organisation 

de concepts par le mode de presentation et par un contexte, 

un affichage d'une partie des concepts dans la liste de presentation et de I'organlsation de concepts pour 
Tutillsateur et une limitation de Tafflchage de concepts par le mode de presentation et par un contexte, et 
une autorisation pour rutillsateur de navlguer k travers les concepts, par les etapes de : 
une selection de techniques disponlbles pour i'utilisateur afin de navlguer k travers les concepts et une limi- 
tation des techniques par un contexte et par le mode de presentation, et 

une utilisation d'une technique de navigation pour navlguer k travers les concepts en reorganisant dynami- 
quement les concepts. 

12. Processus suivant la revendication 11, caracterise en ce que : 

retape de produire une liste de presentation comprend une production d'une liste de presentation dimenslon- 
nee (328) de concepts dimensionnes (292) k presenter dans un espace k n dimensions, 
I'etape de produire une organisation de concepts comprend une organisation, dans un espace k n dimensions, 
de la liste de presentation dimensionnee, 

retape d'afficher une partie des concepts comprend un affichage pour I'utilisateur d'une pluralite de concepts 
comprenant simuttanement un concept de centre conceptuel et une pluralite de concepts satellites qui sent 
organises par dimensions, et 

retape de permettre k Putilisateur de naviguer comprend une presentation k Putilisateur d'une technique de 
navigation k travers les dimensions. 

1 3. Processus suivant la revendication 11 . caracterise en ce que retape d'agencer dynamiquement les concepts dans 
des categories comprend en outre : 

une organisation de concepts par teur degre de similitude, 

une production d'une piuralite de definitions de similitude (390), et 

une selection d'une definition de similitude (398) par les etapes de : 

produire une liste de caracteristiques seiectlonnees (781) k utiilser dans une definition de similitude (390X 
produire une liste de valeurs de caracteristiques seiectionnees (783) k utiliser dans la definition de simitrtude^ et 
produire une ponderation d'eiements de la liste de caracteristiques seiectionnees et de la liste da valeurs do 
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caractdristiques sdlectbnndes, k utiliser dans la ddrrnition de similitude. 

14. Processus suivant la revendlcatton 13. caractdrisd en ce que : 

I'dtape de produire une liste de presentation comprend en outre une production d'une lists de presentation de 
similitude de concepts de similitude (404) k presenter, et une selection d'un concept sup6rieur (410), 
retape de produire une organisation de concepts comprend une organisation de la liste de presentation de 
similitude par degrd de similitude de concepts Jusqu'au concept superisur, en utilisant la ponderation, 
i'dtape d'afficher une partie des concepts comprend un affichage pour I'utilisateur d'une pluralitd de concepts 
comprenant stmultandment un concept supdrieur et une pluralrte de concepts (430), (432) qui sV rapportent 
et qui sont organises, par similitude, jusqu'au concept superleur, et 

retape de permettre k Putilisateur de naviguer comprend une presentation k Tutilisateur d'une technique de 
navigation k travers les concepts de similitude. 

15. Processus suivant la revendication 11, caracterise en ce que t'etape d'agencer dynamiquement les concepts en 
categories comprend en outre : 

une organisation des concepts par perspectives (100), 

une determination d'une perspective en tant qu'une conjonctlon de valeurs de caracteristiques comprenant 
une valeur de caracteristique pour chaque caracteristique de la perspective, 

une organisation de perspectives en categories de perspectives (1 02) comprenant des perspectives physiques 
(104) et des perspectives fonctlonnelles (110), des perspectives physiques comprenant des perspectives qui 
sont organisees par des relations physiques (111 ). des perspectives fonctlonnelles comprenant des perspec- 
tives qui sont organisees par des relations fonctlonnelles (115). 

16. Processus suivant la revendication 15. caracterise en ce que : 

retape d'organiser des perspectives en categories de perspectives comprend une organisation de categories 
de perspectives (102) en une plurailte de types de perspectives (112) dans chaque categorie, 
retape de produire une liste de presentation comprend les etapes de : 

produire une liste de perspectives de concepts de perspectives (202), qui represente differentes perspectives 
d'un concept focal (150), 

seiectionner une categorie de perspectives, et produire une liste de types de perspectives (106) en seiection- 
nant un ou plusieurs types de perspectives (112) k partir de la categorie de perspectives, 
retape de produire une organisation de concepts comprend une organisation de la liste de perspectives de 
concepts de perspectives suivant les types de perspectives seiectionnes, 

retape daff icher une partie des concepts comprend un affichage pour Tutilisateur dun ou de plusieurs concepts 
et de leurs perspectives (100) organisees par types de perspectives, et 

retape de permettre k rutilisateur de naviguer comprend une presentation k rutilisateur d'une technique de 
navigation k travers les perspectives. 

17. Processus suivant la revendication 11, caracterise en ce que retape d'agencer dynamiquement les concepts en 
categories comprend en outre : 

une organisation des concepts par leurs representatbns graphiques (616), 
une production de representations graphiques des concepts (616), 

une decompositbn d'une representation graph ique en un nombre de sous-composants (607), et 
une production d'une liste de modifications admissibles pour un sous-composant (628), des modifications 
admissibles comprenant des modifications que rutilisateur peut realiser dans te sous-composant dans un 
contexte particulier. 

18. Processus suivant la revendication 17. caracterise en ce que 

retape de produire une liste de presentation comprend une production d'une liste de presentation dimages 
de concepts tfimages (640) qui peuvent etre presentes. et pour seiectionner un concept d'Images pivotantes 
(572). 

retape d'operer une organisation de concepts comprend une production d'une organisation parmi les concepts 
d'images sur base de relations entre les representations graphiques de coru:epts d'tmages, 
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r^tape d'afficher une partie des concepts comprend un affichage pour i'utilisateur du concept d'image pivotante 
et \a representation graphique de concepts d'tmages pivotantes, et 

retape de pernnettre § f'utillsateur de naviguer comprend une pr6sentatk»n k futilisateur d'une technique de 
navigation h travers les concepts d'images. 

19. Processus sulvant (a revendication 11. caractdrisd en ce que I'dtape d'agencer dynamiquement les concepts en 
categories comprend en outre des moyens de limitation d'^quation (491) pour organiser les concepts en une 
representation graphique manipulabte tfune equation. 

20. Processus suivant la revendication 11, caracterise en ce que fetape d'agencer dynamiquement tes concepts en 
categories comprend en outre une organisation des concepts en un reseau semantique (1180). 
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